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ABSTRACT 


The closely-related problems of designing reliable feedback 
stabilization strategy and coordinating decentralized feedbacks 
are considered. Two approaches are taken. A geometric characteri- 
zation of the structure of control interaction (and its dual) is 
first attempted and a concept of structural homomorphism developed 
based on the idea of ^similarity* of interaction pattern. The idea 
of finding classes of individual feedback maps that do not 'inter- 
fere* with the stabilizing action of each other is next developed 
by identifying the structural properties of non-destabilizing and 
LQ-optimal feedback maps. Using this approach, we were able to 
firstly generalize and make transparent some known stability pro- 
perties of LQ-feedback, and secondly to provide some partial solu- 
tions to the reliable stabilization and decentralized feedback co- 
ordination problems . A concept of coordination parametrization is 
introduced, and a scheme for classifying different modes of decen- 
tralization (infoimiation, control law confutation, on-line control 
implementation) in control systems is developed. 
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CHAPTER 1 


INTRODUCTION 

1. 1 Problem Background and Brief Historical Review 

Many significant control problems in the real world involve 
the use of multiple control inputs to regulate a dynamical system 
with a multiple number of desired outputs through a multiple number 
of measurement and monitoring devices. Typical examples range from 
nuclear reactor control and industrial chemical process control to 
multi-reservoir river basin regulation and electric power 
distribution. 

Conceptually, the presence of a multiple number of physically 
distinct control input channels which can be actuated independently 
gives rise tp a consideration of the interaction between the input 
signals independently applied to the system from the different input 
channels. In particular, it gives rise to a consideration of those 
interaction characteristics that are in some sense inherently 
determined by the system structure itself, i.e. by the way the input 
channels are connected to the system dy n amics . Dually , the use of 
multiple measurement channels providing information that can be 
independently processed raises the conceptual issue of observation 
interdependency , while the desire to similtaneously regulate a 
multiple number of distinct physical outputs leads to an immediate 
recognition of the problem of interference (or conflict) of output 
regulation objectives . 


It is fair to say that what complica-es irost our understanding 
of many multivariable system control synthesis problems is not so 
much the size of the system involved, but rather their lack of 
modularity ; one usually has a situation where the signal injected 
at one input channel necessarily interact and interfere with those 
from other inputs, making it difficult to determine how they 
eventually affect the outputs individually, it is such 'coupling' 
and 'cross-talk' that makes a sin5>le decon^sition of the overall 
system control sysnthesis task into smaller independent tasks 
impossible, i.e. one cannot specify what trajectory a particular 
output should be manipulated to follow without considering what 
undesirable interference this might necessarily iit^ose on the achieving 
of other output objectives, and one cannot specify what signal should 
be injected at one input to achieve any given desired objective 
without knowing what the other input channel signals are to be. 

On the other hand, the phenomenon of interaction leads 
naturally to the dual concept of redundancy ; if two controllers 
both affect an output, there is in a sense a redundancy of control- 
lability of that output, assuming that both controllers are accessible 
by the same control agent. Similarly, if one has access to two 
sensor to two sensor channels that overlap in their observability , 
there is a duplication of some (extractcible) information about the 
system. The concept of redundancy in^ turn is intimately related 
to another fundamental engineering concept, that of reliability . 

Indeed, redundancy is the very key to construct a reliable system 
out of unreliable conponents : a rediindantly-controlled output 
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remains croiitro liable when one input fails, or is effectively compen- 
sated when extra disturbance is injected. 

As we have erphasized, the structural concepts we have 
introduced so far arise naturally from considering the inputs, 
sensors and outputs as independent , dis tinct entities , i.e. from 
considering the internal structure of the input, sensor and output 
space. Indeed, it is fair to say that a major concern of 'classical' 
control theory has been the independent exploitation of every 
available degree of freedom (e.g. the number of feedback loop 
entry points available, reading to such concepts as 'single- 
degree-of- freedom configuration* feedback and 'loop shaping', 
see [4]). It is also precisely this detailed need to consider 
every degree of freedom individually and independently that made 
classical control methods unattractive for systems witli a large 
number of degree of freedoms. 

As we know, the 'modern' state-space optimal control theory 
that subsequently sii^erceded the classical approach have succeeded 
in overcoming this problem of ' dimensionality ' by going to the other 
extreme - that is, by 'ignoring* the internal structure altogether. 
The state-space approach allows one to mathematically 'lump' 
a high-dimensional problem into one conceptually equivalent to 
a uni dimensional one {multiple scalar inputs become a single vector 
object, etc.), while the use of cost criterion optimization (e.g. 
the standard Linear Quadratic optimization approach) allows the 
implicit trade-off between different output objectives and simul- 
taneous determination of all the control inputs. Thus, modem 
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optimal control allows one to 'solve' a multivariable synthesis 
problem without knowing anything about the structure of the system 
(as opposed to numerical data) . In obtaining the simultaneous 
control strategies , one never has to worry about and have no control 
over, how the different control input signals so determined will 
interact. Such structural concepts as controllability and obser- 
vability are used only to the extent of providing a test on solva- 
bility , and in any case their aggregate nature (’can all the 
control channels combined together control all the states?') is 
of no help in understanding the internal structure of control 
interaction . 

It is precisely because conventional optimal control theory 
does not demand structural information for its problem formulation 
that it is Incapable of e xploiting such information. If one knows 
that the A, B matrices of a state-space equation are really a model 
of a chemical plant, and one really has a lot of intuitive and 
physical understanding of the behavior of the many subsystem chemical 
processes involved, all that insights are irrelevant in an optimal 
control design formulation, in so far as one cannot translate them 
into one's specification of the 'weightings' in the cost criterion 
and of the optimization constraints. (In fact, 'optimal' control 
problems are often formulated as if the choice of the cost criterion 
can be made independent of one's knowledge of the systme's properties 
and limitations.) 


It is thus the case that one often has to ignore an awful 


lot of inforitiation in solving a design problem using optimal 
control theory. In practice one often 'iterates* on different 
choices of cost weightings until the resultant behavior is 'intui- 
ively' satisfactory; yet the theory itself provides no insight 
as to how the weightings should be 'iterated*. 

In particular, the conceptual ' liatping* iirplicit in such a 
'centralized' optimal control framework precludes all considerations 
that have to do with the fact that the control inputs (and sensor 
outputs) are physically distinct and independent entities. There 
are at least two contexts when such considerations are crucial. 

First is the case when physical failures of control inputs are 
inportant, and one wishes to design reliable system pe;.formance 
by e^^loiting control redundancy. Such system reliability problems 
cannot be addressed without an understanding of how the different 
failure-prone control channels structurally intertwine. (Dually, 
to understand how a sensor failure affects state reconstruction 
performance, one needs to know the internal interdependency struc- 
ture of the measurement system as a whole.) The second case arises 
when the centralized control actuation assunption is invalid, 
as for exanple, when different decision agents have access to 
different control channels and conpute their actuation signed.s 
independently . To analyze the large classes of such emd related 
decentralized control problems, where the iadependence of the 
control channels (and the observation channels) is the essence 
of the matter, the internal pattern of observation and control 


overlapping becomes indeed the primary object of studies. 



The recent trend of deveit^i'ment towards a theory of decentra- 
lised control of large-scale systems with 'non-classical' infor- 
mation pattern^ or team decision problems (see e.g. fM31 , [C3]) 
has contributed much towards a better understanding of the theoretical 
issues that arise when more than one control agent act on the system. 
However, most contributions in the literature have focused attention 
on the effect of stochastic uncertainties on controller strategies, 
and on the technical conditions for guaranteeing existence and 
optimality of control strategies. The a priori , structurally 
determined aspects of control decentralization and information 
decentralization have not been given much considerations (exceptions 
being the recent papers of Aoki [A3, 4] and Eckberg's thesis [El]). 

The same lack of exploitation of structural information can be said 
of much of the linear differential games literature. 

The true revolution in thinking about the role of the use of 
system structural information came with the more recent introduction 
of the 'geometric' approach to linear multivariable control, as 
initiated independently by Wonham [Wj, 6], Morse [M6, 7] and Basile 
and Marro [Bl, 2] , The geometric approach provided the first 
convenient mathematical tools for a coordinate- free , invariant 
description of system structural properties (see also [P2]). 
Furthermore, its philosophy of posing control problems as feasi- 
bility questions (as opposed to optimality ) leads naturally to 
constructive proof in terms of algebraic system structural charac- 
terization. It is thus realized that the conventional charac- 
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terization of a system as controllable, observable, stable, etc. 
is too crude : oen needs to know which state is controllable by. which 
control channel, which subspace a control can influence without 
disturbing other states outside of that subspace, etc. Indeed, the 
first major vse of internal structural concepts in control problems 
occurred in the area of decoupling (or non-interacting) control 
(see ^M6] ) . Although the decoupling problem has a long histoiy 
(see, e.g. [H 4]), it is only after the introduction of geometric 
structural concepts that the essence of the problem is made trans- 
parent. Another class of problems for which structural concepts 
have provided transparent solution is the so called ’disturbance 
localization' problems (see [H4] for its classical origin and 
[W6] for its 'geometric' solution). 

A fundamental conceptual contribution of the structural 
approach has been the lights it sheds on the role of (linear) 
feedback in linear system. It becomes obvious that, among other 
things, many control synthesis problem can be formulated as achie- 
ving certain structural configuration using feedback. The extent 
of structural changes acdiievable through feedback application relates 
intimately to the internal interaction structure of the input 
channels. It is well-known that an outstanding characteristic 
of many conventional multi-input, multi-output control problems is 
the high redundancy in the degree of freedom available for their 
solution. For exanple, in the 'standard* linear modal control 
(pole assignment) problem (see, e.g. [P4]), an infinite number 
of different control feedback gain matrices can achieve the saine 
pole allocation; the problem specification is highly incomplete. 



Conventional solutions (’dyadic' feedback, etc., all basically 
amount to reducing the multi- feedback problems into one with 
scalar feedback) is purely of mathematical convenience, and has 
absolutely no physical basis whatsoever. A (dual) example is 
the standard Linear Quadratic (LQ) problem, where whole subspaces 
of the parametric space of the output weighting matrix map into the 
same optimal feedback. The redundancy in solvability freedom of 
many such problems are intimately related to the degree of inter- 
action or coupling of the input channels (and dually) . The iirportant 
recognition is that two different combinations of feedback from 
the individual input channels that yield the 'same' closed loop 
system behavior may well have widely different properties with regard 
to other considerations, e.g. stability under arbitrary feedback 
loop failures, or under plant structure perturbations, or under 
sensor failures, or under saturation effects previously ignored, etc. 

In summary, we have attempted to indicate the role and impor- 
tance of a suitable system structural characterization of control 
interaction (and its various dual versions) as a basis for tackling 
many classes of control problems. We have in particular identified 
two broad classes of problems , systems reliability and multi- 
agent control problems, for which we feel that a structural 
approach will provide new perspectives and means of attack. We 
have also pointed out the shortcomings of conventional optimal 
control theory, the LQ-theory in particular, and have suggested 
the importance of establishing a theoretical link whereby struc- 
tural information can be incorporated in the optimzation formulation. 
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and whereby the solution can be structurally interpreted. Finally, 
we have reiterated, if inplicitly, throughout the ^±^ove discussion 
the possibility and usefulness of viewing many inportant classes 
of problems as dual to each other within the structural framework 
sketched, thus suggesting a conceptual unification that might 
deepen our insights. 
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] « 2 Thesis Motivation. 


The main motivation of the research reported in this thesis is to 
better understand the problem of system reliability synthesis in the 
context of multivariable control, and to relate that understanding to the 
system structure in a way naturally suggested by the 'duality* between 
the concept of interaction and redundancy. We are quickly led to 
recognize that the class of reliable synthesis problems can best be 
viewed as a subclass of the class of problems where it is natural to 
consider the input channels ( or groups of them ) as 'independent'. 

This concept can be formalized in precise algebraic terms , and 
the idea of exeunining the intersection structure of variovis algebraic 
objects that can be generated by such independent 'invariants' in fact 
forms the conceptual basis of our approach to a structural characteriza- 
tion of control interaction in a linear multivariable system. More 
precisely, we will look at the lattice structure generated by the 
collection of individual controllable subspaces , and to examine how it 
gets modified under various 'feedback'. A new concept of structural 
homomorphism between linear multivariable systems also follows naturally 
from our framework, and it is hoped that it will provide a useful tool 
for studying the class of linear multi-input, multi-6ujbput systems. 

While the above ' geometric ' approach yields interesting structural 
insights, it cannot yet be used directly to solve our system reliability 
synthesis problem became a convenient characterization of possible 
modifications of the interaction structure under arbitrary feedback is 
not yet available. We are therefore motivated to take a different approach 
by focussing our attention on the feedback maps instead of the invariant 
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subspaces. In so doing we are firstly motivated by the fact that the 
class of LQ- feedback has 'nice’ stadaility properties, cind hence that 
it might be fruitful to identify other useful classes of feedback maps; 
secondly, the idea of viewing a reliable stabilization synthesis problem 
in terms of determining a set of 'coordinating parameters' that ensures 
non-interference of the individual control feedback actions on the 
stabilizing efforts of other controllers leads naturally to the idea of 
finding suitable parametrization on the feedback maps themselves. 

This idea turns out to be very fruitful. By identifying first the 
class of feedback maps that has the fundamental property that any member 
of the class never destabilizes an originally open-loop stable system, 
and then viewing the LQ- feedback as simply a stabilizing feedback class, 
we were able to generalize and make more transparent some of the known 
structural stability properties of LQ-feedback, Moreover, it allows us 
to contribute significantly towards the solution of the reliable 
stabilization synthesis problem we started off with, as well as offering 
an intuitively interesting interpretation of 'coordination' and 'inter- 
ference avoidance' in the reliability synthesis context. 

The close connection between reliable synthesis and coordination 
of independent controllers leads us to extend the structural understandings 
we have achieved to the class of decentralized control problems. The 
fxondamental motivation here is to define the very concept of decentral- 
ization in terms of the structure of the model. This new perspective 
allows us to clarify several concepts that have been used widely but 
confiisingly in the literature, by pinning down at the very beginning 
what exactly is being decentralized (observation, control actuation, 
strategy corputation, etc.), and why . 
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1. 3 Thesis Organization 


The thesis is organized as follows: 

In Chapter 2, we first consider the problem of characterizing 
the structure of interaction of control inputs (and its dual) using 
the geometric approach and lattice theory. We then excunine how this 
interaction structure is modified when arbitrary feedback maps are 
imposed. A new concept of structural homomorphism between multi- 
variable systems is then introduced. 

In Chapter 3, we take a different approach to the study of 
control interaction, and focus attention instead on the properties 
of feedback maps. We identify first a class of feedbacks that has 
the fundamental property that any member of the class never destabilize 
the originally open- loop stable system, and then show that the class 
of LQ-feedback can be naturally viewed as having the additional property 
that it always stabilizes the open-loop system. This allows us to 
generalize and make more transparent some known stability properties of 
LQ-feedback, Some geometric interpretations of the Riccati equation 
has also been obtained. 

The properties of non-destabilizing and LQ-feedback maps are 

applied in Chapter 4 to study the problem of system reliability 

synthesis in the control context. After examining the various failure 

modes in control systems, we carefully formulate a class of reliable 

stabilization problem and show how it can be resolved by solving the 

class of reliable LQ-synthesis problems. Some results towards the 

solution of the latter are next presented as well as some illustrative 

numerical examples. Tlie natural dual problem of reliable 
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state- reconstructor synthesis is next formulated. We then give a brief 
discussion on the role of control strategy redundancy in system design, 
and conclude with a brief recapitulation of the practical implications 
of our results in this and the last chapter. 

The problem of structural characterization of decentralization 
in large-scale control systenis is taken up in Chapter 5. We first 
present an informal scheme for classifying different modes of 
decentraliza.tion , and then show how several classes of decentralized 
control problems in the linear multivariable system context can be 
naturally formulated within this framework. The idea of non- 
destabilizing feedbacks are extended to tackle a class of decentralized 
feedback stabilization problems. 

Finally, in Chapter 6, we summarize our conclusions and suggest 
future research topics. 
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1.4 NOTATION 


Except for changes to improve clarity we follow the 'standard' geometric 
notation of [W6] , to which we refer the readers for expository details of the 
underlying concepts; see also [Gl] . Note that our notations in (viii) and (ix) 
assume the 'standard' results on LQ-optimization and the Riccati equation; see 
[W61 and [W3] . 

(i) small Roman letters x,y,z ... denote vectors# with the exception that the 
letters from i to n and also p,r denote integers. 

k = { l#2,...,k } 

small Greek alphabets denote scalars e R# except when argumented, in which 
case they denote polynomials (see (vi)). 

(ii) Script letters X,/,Z denote vector spaces (finite dim. and over 

the real field) or sAjbspaces. The following designation is fixed; 


X = r" 

denote 

the 

state-space 

II 

•H 

If 

the 

i'*^ control input space 

RPi 

II 

the 

i^ observation output space 

Zi= Rj^i 

II 

the 

i^^ controlled output space 


(i = U X (i X . . .X U 

vV b jC 

V = y^x . . ,x 
Z = xZ^x . . .X 

(iii) Capital Roman letters denote maps between vector spaces. The same 

capital letters will be used to denote the matrix representation of the 
corresponding map . This is a 'standard' abusage; which is intended will always 

be clear from the context. A map D : R."^ will sometimes be equivalently 

denoted as D € r^1^2 
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denotes the dual map (transpose matrix) of F. All maps whose range space 
dimension is less than its domain dimension will be defined in its dual form. 
This notation will be extremely convenient for mental clarity in dimension 
'balancing’ for 'messy* equations. 

If F : S R and P C R, then 

f“^P = |xeS|f(x)eP| 

5 1 eX |x^y ~ 0 V-yes f S k annililator of S 

The following designations are fixed; 

A : X ► X state dynamics map 

X i"*^^ control map 

: X i'th observation map 

: X ■ i"^^ controlled output map 

[ ^ * > X 

• X ' V X .... x V, 

1 k 

and correspond to the system (finite dim., time-inv. , linear) ; 

X = Ax + 

iek 

yi = C^Tx i E k 

zi = Hj^^x i E k 

which we will simply denote as ( A, C? , i e k^ ) 

(when the Ci*^'s and Hj_^'s are not relevant for a particular discussion we will 
shorten ^ to 53” ^ ^ ^ 

will also be used for ye ^ . . . x V, 

X Jv 
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Iv) Given 5 ^ ^ , A S ^ 5 , 

A 1 5 = restriction of map A to S 

I 

X = X/S * factor space of A w.r.t. S 

A, B, C ® maps induced by maps A#B,C in X such that ^he 
following diagram commutes ; 

x.e. AP = PA, C^P « C 
B = PB 

Note that ^ is well- 
defined iff N(cT) c S 

X = induced element in X 

v) Range space, of map B = R(B) 

Null space of map = NCC*^) 

d( S ) = dimension of space S 
rk(F) ss rank of map (matrix) F 

vi) C (C^} = open left (right)-half complex plane 

ir{ X ) = det ( X I - A ) characteristic polynomial of A ( ch.p. ) 
a (X) = minimal polynomial of A (m.p.) 

a (A) ss spectrum of A 

^(A) - N(Qtg(A)) where ) 1 o( ) 

X~(A) ( X+(A) ) - Stable (unstable) siibspace of A in 

U - disjoint union 
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vii) < A jR(B}> = R(B) + A R(B) + ... + a”*^R(B) 

n(c'’^,a) = n n(c''^A^”1) 

i«K 

' S is A-inv <==> sex , AS C S 
S is {A,B)-inv <===> A S C S + R(B) 

S is (C^,A)-inv <==> A{ S Pi N(c'^)) C S 

I(A,B; l/)= {SCI/ I aSC5 + R(B) } 

i(c'^,A ,-1/ ) = { S C 1/ I M S n N(C^)) c s } 

If S e I(A,B; 1/ ) 

F^(A,B; S ) *= { fT : X U j (A+BF'^’)S C S } 

R is (A,B)- c.s. <===> R = < A+Bf"^| R(B) P R> for some F^: X ” • U 

viii) S(A#B) = the stabilizable pair (A,B) 

D{c'^,A) 5= the detectable pair (C^#A) 

C(A,B) = the controllable pair (A,B) 

0(c'^,A) = the observable pair (c'^,A) 

ix) given S{A,B) and D(h'^,A) , Q > 0 , R > 0 

T 

K = K(A^B,H ,R,Q> denotes the unique positive semidefinite solution to 
the Riccati equation (algebraic) : 

PA + A^P - PBR"^B^P + HQH^ - 0 
( Q and R will always be assumed of compatible dimension) 

For R = I, Q = I, we will simplify to K = KCAfB^H*^) 

Note that the notation K = K(A,B,H^,R,Q) will only be used when SD(A,B,H^) 
and Q > 0 and R > 0 . Hence whenver K occurs it will be unique, well-defined |, 

and > 0. 
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CHAPTER 2 


GEOMETRIC CHARACTERIZATION OF INTERACTION STRUCTURE 
2,1 Introduction 

In this chapter we consider the problem of developing convenient 
mathematical characterization of the structure of control input inter- 
action (and its dual) in a finite dimensional, linear time-invariant 
multivariable system. As our basic tools we will take the *geomatric* 
approach of Wonham and Morse [w6] and also Basile and Marro [b 1,2] . 
However, the class of problem we want to formulate and examine is 
different from those previously considered by them. 

The word 'interaction' has appeared frequently in the litera- 
ture on multivariable control, although the underlying concept intended 
by different researchers is by no means homogeneous. On the whole, the 
word 'interaction' has been taken to mean one of two things: 

1) 'state coupling' : the usual situation is this- We are given a 
state-space model with a distinguished partition in a distin- 
guished coordinate frame : 



from 'physical' consideration one regards the pairs (A^j^,B^), 

as two different subsystems and the matrices A^^^ ' ^21 providing 
coupling betvreen the state vectors and . One then talks about the 
'interaction' betv/een the state vectors and x^, and derive concepts 
such as 'weak interaction ' and 'singular perturbations' based on condi- 
tions related to the ' magnitude ' of the 'coupling' terms ^ 2 . 2 ' ^'21 
'time constants' of A^ and (see e.g, [A2] and references cited in TAG]). 
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The recent 'hierarchical' approach of Rosenbrock tR5] which considers 
arbitrary interconnections of subsystems falls within this framework of 
analysis. 

(2) Input-output transmission interaction 

This interpretation is the standard one in the literature on 
decoupling (non-interaction) . Given a square input-output transfer function 
H{s), or equivalently a realization : G^(sl-A) = H(s)# the system 

so represented is said to be interacting if more than one control input 
affects an output or more than one output is affected by the same input; 
i.e, H(s) contain non-diaqonal terms (up to a permutation). The classical 
decoupling problem consists of finding suitable conpensator such that the 
resulted cascaded system transfer function becomes diagonal. The subsequent 
state-space algebraic approach of Wolovich and Gilbert [G2]/ and the more 
recent geometric formulation of Wonham and Morse [M6] have substantially 
expanded the problem's generality (and transparency) , but the basic concept 
on interaction remains that of input-output transmission interference. 

A different interpretation of interaction will be considered in 
this thesis . Our starting point is the recognition that two things are 
involved in input-output transmission; how the input channels get connected 
to the state dynamics , and how the output channels get connected to the ^ 
state dynamics. This observation is or course irrelevant in those 'black 
box' situations where the inputs and outputs are the only physically 
significant (and knowable) quantities , so that any one particular state- 
space realization (C /A,B) has no physical meaning. However# many real- 
world physical systems cannot be so regarded: we oftan have a situation 
where the state space itself do represent physically significant quantities# 
and where the 'given' control inputs and observation outputs in the model 
often represent only the existing channel implementation# rather than the 
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full set of physically available/khowable quatities, while the set of 
•given' controlled outputs may well simply represent a selection (or 
definitional combination) of the physically significant states, and are 
often non-identical to the observed variables. In those situation where 
the state-vector itself represents physical quantities, therefore, it becomes 
meaningful to study the input-to-state and state-to-output structures 
separately. 

Adapting the latter viewpoint, we are therefore led to examine the 
internal structure of input-output transmissions, in terms of (1) the input- 
to-state interaction (how the controllable subspaces of different controllers 
intersect) and (2) the state -to-output interdependency (how the observable 
subspaces of different measurement channels intersect) . It is thus seen 
that the input outp\:it transmission interaction can properly be viewed as 
the contoined effect of input-to-state coupling structure and state-to- 
output structure. This accords with our intuition; suppose two systems ^ 
have identical input-to-state structure as well as state dynamics, but 
different state-to-output structure (because . they are required to regulate 
different quantities, for instance), and hence different input-output 
properties. One ought to be able to recognize their 'similarity* with 
respect to input-to-state behavior, but such a notion of 'structural' 
similarity cannot be gotten if we just look at the control input-controlled 
output properties - the different output structures simply mask and disguise 
that input similarity beyond recognition. 
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2.2 Lattice structure of control interaction 


Hie basic idea in characterizing the structure of control 
interaction is to indentify the intersection pattern of the control- 
lable subspaces of the individual controllers , and to determine 
how the internal cyclic structures of the controllable subspaces 
intertwine where they intersect. Characterization of observation 
interdependency structure follows by simply taking \.he dual. Next, 
allows arbitrary feedback maps and use the idea of {7i,B)-inv sub- 
spaces to examine how the input-to-state interaction structure can 
get modified. The change in state-to-output observability inter- 
twining under feedback is next to be characterized. By combining 
the last two characterizations we then obtain the input- to-output 
interaction properties. Finally, by restricting the class of allowed 
feedback maps , interaction modification under output feedback can be 
studied. Due to lack of time this program has been carried out 
only very partially, but even then we will see that the partial 
results we have so far obtained provide useful insights. 

The underlying algebraic structure we will exploit is that 
of a lattice . (see [SI] , [B5] for the basic definitions and pro- 
perties of lattices) 

Let X a finite- dimensional vector space over the real 
field. It is known that the set of all subspaces of x forms a 
lattice (under the inf and sup operations of n and U respectively) 
ordered by set inclusion C . Moreover, it is known that this 
lattice is infinite, modular, complete and complemented. Now 
let A be a linear map:X X, and define I(A)^{ 5 |aSCI5 }, i.e. 

1(A) is the set of all A-invariant subspaces of X. It is easy 
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to show that I (A) forms a sublattice of the lattice of all subspaces 
of X, I (A) is always modular and complete; however, it needs NOT 
be infinite or complemented. We have in fact the following results 
from Brickman, etc. IB6] : 

Fact 2.2.1 

(i) 1(A) is finite iff A is cyclic 

(ii) I (A) is complemented iff A is diagonalizable 
(ii) 1 (A) is distributive iff A is cyclic 

Note that (ii) , (iii) imply that, if A is cyclic and diagona- 
lizable, then 1(A) in fact forms a Boolean algebra. In this special 
case, the atoms of the lattice 1(A) are simply the n one-dimen- 
sional (distinct) eigensubspaces of A, where n=d^X^ , and 1(A) 
consists of the 2^ possible unions of these eigensubspaces. 

Consider now the system 1=(A,B^,C^ , ieiO 

it = Ax + Zb.u. (2.1.1) 

1 ' 

y. = c.x, lek 
1 1 -- 

where d(X3 =n, d(a^)=m^, d(/^)=p^, ^^^=P 

(see Notation 1.4) 

Note that we are regarding the k groups of inputs (the u. *s) 
as independent. For convenience we will refer to the i"*^^ group 
of control inputs as simply 'controller i’. 

The controllable subspace of controller f is given by 

<aIr{B.)> a R(B.) + ARIBJ + +A^“^R(B.) 

' 1 — 1 1 1 
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<AjR(B^)> has the following algebraic properties: 


Fact 2.2.2 

1) <a1r(B^) >= inf { S j aSCS ,R(B^) C S ( 

2) <a|2:r(bj> = S<A Ir(b.)> 

11 1 X 

3) <A+B.F. !r(b. )> = <a|r(B.)> V linear map F^: X - U. 

4) Let AS c 5 ^ Xet P be the canonical projection; X ■* X/S 

Then P<A Ir(B.)> = <a|r(B.)> 

X ' X 

where PA=AP# and R(B^) = (R(B^) tS)/S 

5) Let Jk ^ ^^<a|r(B )>^ letRC<A|R{B^)> decompose 'X, i.e. 

aRCR and 3 SC<a]r(B^)> s.t. tSCS and R©S = < AjR(B^)> . If 

Q: <a|r(B^)> <a.1r(B^)> is the projection onR alongS , then 

R = <a|qr(b.)> 

1 X 

Note that (1)=^>< a|r^B.)> is an A-invarxant subspace of 

' X 

{A-inv for short) . 

The {<a|r{B^) in general have arbitrary intersections. 
When <A|R;<B^>>n<A[RCB J> ^ 0, then any stated <a[r{B^)>TKa[r(B J > 
will be controllable by both u. and u. . The first step towards 
a structural analysis therefore consists of the idea of isolating 
those 'states' that eire interaction free', Wore precisely, we 
warit to isolate the maximal subspaces R j such that RjC<a1r{B^)> 
and Rjn<AjR(B^)> = 0 for i ^ j. We can in fact continue this 
decomposition for subspaces controllable by only two controllers , 
etc. The result can. be succinctly stated as; 
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Theorem 2.2.1 


Let X A <a|ER(B J > 

1*“ iek ^ 

X A Z[<a7r(b. )> n <a|Ir(Bj)> ] = 
2 iEic ' jek-{i} 


n[<A|ER(Bj)> j 
iek jek-{i} 


X^ A 2 [<a]Ir(B. )> n < A|SR(Bi)> ] = n <a|2r(B. )> 


iqc_ i£i 

ii=j-i 


X. A n<A|R{Bi^). 
^ iek 
Then A X.CXy 

X X 

X. =s©x.., 

X IT x+l 


iek-I 


iCk iek- I 


■^1 ^ '^2 ^ 


5 {n<A[R(B )>+ X / X ) 

Trt -! c-T J ^ 


jel 


ICk j ei 


( ^ca1r(b. )>/[ n<A|R(B. )>nx- 


jel 


i+1 


]) 


I = i 


moreover, if d(<AjR(a )» = n^, iek 

d(X^) =Z^, iek 

then 2ni = 2:-f-i 

iek iek 

ggP-^ See pp_ 35 


(2.2.2) 

(2.2.3) 


(2.2.4) 


(2.2.5) 


Remark X is the smallest A-inv subspace such that -ypX x is control- 

j j 

lable by at least j of the controllers. ^ is the siibspace of all 
states controllable by exactly j controllers. Our result says that 
is decomposable into a direct sum of subspaces, each controllable 


G) 


by a distinct combination of j out of the k controllers (there are 
such possible combinations, but of course many of these will yield 
the zero subspace) 

Remark X^^^is just the controllable subspace of the pair ( A,[ , . . . ) 

and is of dimension . Wonham has suggested that ( 2n,-'^p) can 

iEk * 

serve as a measure of the ' degree ' of interaction between the subspaces 
<^A|R(Bi))>, Our results above suggests that the list 
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( provides a much sharper measure. 

Itemark 

For i=l, in (2.24) we have the interaction- free sub- 

spaces# i.e. 


We note the following special cases : 


1) Complete non-interaction : 

X = 0 < A I s E(B. ) > = <A I R(B )> © . . .©< A j F(B ) > 

^ iek ^ 

2) Couple te interaction : 

X = ... = ){ <==> <;a 1 2 P(B.)> = <A 1 R(B. » V iek 

j. K i r 

3) Centralized interaction ; 

X=...= X <r===^> ^ I Se(b. ) > = S 0 ... 0 n<AiP{B.)> 

^ iek ^ iek ^ 

where -(A |RCB.))> = S. . 0 Pi <(A |p(B.))> 

^ j£k ^ 

4) 'Nested' interaction : 

for some permutation : (l,...,k) > (i^, . . . #ij^) , 

X=<A(K(B )> #..., X=<AiE(B »<s==^ <AIR(B )> c . ■ • C <A ( P(B )> 
^ ''l ^ ^k ^1 

5) 'Neighborhood' interaction : 

(<AlP(B. )>P<a1p(B. )>)©...©( <A I F(B. )>n<AlP(B. )> 

^1 ^2 ^k-1 ^k 

-='==> <AlR(B, )>n<A|R(B. )> =0 , lm-jl>l 

m j 


The following easy consequences of Theorem 2.2.1 are also noted : 
Corollary 2.2.1 

1) R(B^) C X^ <==> <A| R(B^))CXj V j Ek 

2) S E(B.) C <A 1 i R(B.)/ <====><A 1 S R(B . )>C X , 

i£I ^ iek-i^ i£l ^ 
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The neKt thing we want to do is to introduce more structure into 
the original space X . The simplest thing to do is to allow a partition 
of Xf so that certain subspace of X is made 'distinguished'. Briefly, 
the program is as follows (see W [6]). Partition the coii^jlex plane as 

A 

C = ^ g ^ where C ^ ^ g* where C roughly represents 

the undesirable domain of C that we might want the poles of A to avoid . 

Next partition the m.p. of A as a (X ) = a (X )a . (X ), where the 

g b 

zeros of Oj^) e C C j^) . Then we have 

X= X (A) tt) X . (A) with X ( A) = N ( a (A) ) 

g o g g 

and A X gC X^, A X C X X (A) = N { a (A) ) 

We can now consider the interaction structure w, r.t. 
distinguished X X. 

Definition 2.2,1 

The system (2.2.1) is C - assignable w.r.t. u. iff 
X b'^<A |R(B^)> 


Definition 2.2.2 


The system (2.2.1) is individually C - assignable w.r.t. {u,}, 

g i lek 




Remark 

If X =X ^(unstable subspace), def. 2,1,1 corresponds to the 
definition of stabilizability w.r.t, u^. 
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T T I ^ 

By noticing the duality s N(c ,A) = < A |R(C)> , we see that the dual 

concept of observation redundancy (overlap of observability) can be cuialogous-ly 
defined by simply taking the dual of Theorem 2.2.1. 
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Proof of Theorem 2.2.1 


A X . C since A-inv subspaces form a lattice under 

the operation of intersection and sum. 


That ^ "^j easy to check 

(2.2.4) follows from repeated application of Lemma lO.l(iii) of 

[W6] , pp.249, and the fact that (R ^ + R ^)/ R ^ ~ ^ 

To prove (2.2.5), note that d( X^) = d( X t d( S ^) 

k k 

so Z 1. = 2 d{ X .) = 2 2 d( 5 .) 


i£k ^ 

iek 

X 

j=l 


= d( S^) + 

2d( S 

2» ^ 

But the right 

hand side is 

just 

2 




i €k 



2.3 Modification of interaction structure under State feedback 

While <A + | R(B^)> = < A [ R(B^)> V F^iX — > It is NOT true 

in general that < A + R(B.)> = <A | R (B.)> for j i. 

That is , the controllable subspace of one controller can be altered by the 

T T 

feedback actions of other controllers. Similarly, N , A + ^ “ 

N(C.^,A) V K. , but N(C.*^, A + B.K.C.*^) ^ N(C.'^, A) in general if 
1 1 1 jjj i 

t j , i.e. the unobservable subspace of one controller is alterable 
by the output feedback of other control agents. 

In this section we therefore turn to exa.,-.ne how the interaction 
structure of S= i eK) can be altered by arbitrary state feedback 

loops . 

This problem has been examined by Aoki in [A3], [A4] for the case when k=2. 
We will therefore summarize some of their main results, generalizing where 
possible. We begin with 

Lemma 2. 3.1 

<A t E B.F.'^ 1 r(B.)> = <A I I R(BJ> V F,^: v n 

j^i 3 ^ ^ iRk ^ ^ 

Remark 

Even though the individual controllable subspaces are alterable by 
feedback, the sum of all the controllable subspaces is an invariance 
under feedback. 

Lemma 2.3.2 [a4 ] 

i) 3 such that <A + 52 ^ 2 "^ jR(Bj^)> = < a | R(Bj^) + 
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ii) If A is cyclic over < A | R(Bj^) + , and <A | R(B 2 )>- ^ N(Cj^"^) 

then 3 such that < A + 1 R(B 2 ) > • A | R{Bj^) + rCB^):^- 

The above results show that the controllable: aubspace of anyone control cari 

always be made 'maximal'. The inverse case, i.e. of minimizing the controllable 

subspace of one controller by the feedback actions of others can be solved 

(see [A4]) by Wonhara and Morse's index algorithm [W7], by noticing that 

inf lcA+B 2 p 2 [R(Bi>="( “ inf )S| A5CS +R(B 2 ) » S 3R(B^)| 

^2 

However the algorithm is fairly complicated. Our next result provides a partial 
characterization that is more es^licit: 

Lemma 2.3.3 

K-tl K 

If A R(Bj^) C (R(Bj^) + ....+ A^R(Bj^)) + R(B2) * 0< k £tt-2 (2.3.1) 

T 

then 3 such that 

<A+B2F2lR(Bj^)>C R(Bj^) + + A*''R(B^) 

Proof 

(2.3.1)<=> A(R(Bj^) + ...+ A*^R(Bj^)} c (R(Bj^) . ,+A*^R(B^) ) -t R(B 2 > 

<==^ (R(Bj^) + . . A*^R(B^) ) is an (AfB^) - inv. 

<==> 3 S.t, (A+B^F^) (R(B^)+. .,+ A*^R(Bj^)+. .,+ A*^R(B^)) C (R(Bj^) + ... 

+ A*^R(Bj^) ) 

===S> <A+B2F2lR(Bj^)> C R(B^)+. ..+ A*‘R(Bj^) 
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Exatrple 


Consider 



In this case AR(b-j_) C lemma 2.3.3. 

T T T 

3 s.t. < A + ^ 2^2 I ^ R(B^) . In fact, is even unique, 

and = [0, ..., 0, -1]. This is in a sense the 'canonical' situation 

for a controllable subspace to be reduced to its minimum possible 

dimension. More generally, we have ; 

lemma 2, 3.4 

Let <A Ir(B^) ■»■.,.+ Rt\)> = X , d(R(B^))=l 

and let A^^“^ Bj^, ... a'^ 2"^ ..., A^Jc”! Bj^l spans X 

where cj > a_> > 1 , Ea. = n 

1— - 2— — k— . . 1 

lek 

are the controllability indices of (A, [B^,..., B ]). 

X- iw 

T T 

Then :3 , . . . , Fj^ such that 

< A + ^2^r' •**' **■ ®k®’k^l ^^®1^ + ... + A^l“l R(Bj^) 

< A + B.F,^ + B^F^"^ + ... + B.F, *^1 R(B„)> t ...+ A^l"l RCB^ ) 

11 33 kkl2 ''l 1 

+R(B2) + ... + A^2^^ 

< A . .... R(B^» = X 


i. ''U 

This result follows a straight-forward application of Wolovich's 


'canonical structure' theorejtCW4] and hence is oinmited 



2.4 Structural Homomorphisms 

In this section we introduce a concept of 'structural' homomorphism 
(or similarity) for the class of systems 2 , ie Ic) based on the 

idea that , if the lattice structure generated by the controllable (obser- 
vable) subspaces of the individual controllers (sensors) of one system is 
similar to that being gerorated in another system, then the two systems 
will have similar interaction (interdependency) pattern. The basic 
motivation here is to provide a more precise means for studying classes 
of systems with similar interaction (interdependency) characteristics. 

What, for instance, is the c]ass of objects we are really referring to 
when we talk about 'noninteracting* systems , 'weakly interacting* systems, 
etc. ? 

Without loss of generality we will assrnne in this section that 
the following assumptions hold: 

1) X = < A I R(Bj) + . . ,+R(Ej^> > 

i.e. the system is controllable and observable if a central agent has access 
to all the control and observation channels . 

We will first introduce the conceptual definitions, then discuss 
their interpretations. 

Definition 2.4.1 

Let be two lattices. A lattice homomorphism f is a map 

f : " '*■ such that V ®x'®2 * ^1 * 

f{sj^y s^) = f(Sj^) u f(s2) 

f (s^n s^) = f(s^) n f (S 2 ) 
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Definition 2.4.2 


Let Ij^,l 2 be bounded, complete lattices, and let C ^ ^2 

be fixed finite sublattices such that 

- sup s . sup , ana iJjl = IJjl 

Further, let , ^2 ^ ^2 fitted elements 

Then (l2,J2'^2^ said to be a structure homomorph of if there 

exists a lattice homomorphism 


such that 1) is a bijection : * *^2 ' 


Definition 2.4.3 


.»v 

Given the two systems E =(A,B^,i ek) and E =(A,B^,ie k) with 
Xj_ ^I(A) , €: I (A) two fixed subspaces, we say that the pair (t ,X^ ) is 

A A 

an input homomorph of ( S ,Xj^ ) iff 

{1(A), {<a|r(B^)> b^ is a structure homomorph of 

(I^A), {<a1r(B^)> X 


Remark 

In words, definition 2,4.3 says that one system is input homomorphic 

to another if : 

Dthey have the same number of control input (groups) 

2) whenever an i^jvariant subspace is controllable by some subset of control 
inputs in one system, there is a corresponding invariant subspace 
controllable by a corresponding subset of control inputs in the other 
system. 

3) a 'bad' invariant subspace in one system corresponds to a 'bad* invariant 
subspace in the other system. 
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Leiiuna 2.4.1 


If { Z ) is input-homomorphic to 

X ^ \ X ^ V iek 


A 

(E ,X 


then 


Remark 


The dimension of X 

A , 

need R(b^),R{B^), nor <a[rCB^)> 


A 

and X need not be the same? neither 
and <a|r(B^)> , nor X^ and X^^. 


Remark 


^ 

If Xjj=X f ~ ^ input-homomorphic systems 

not only have 'similar' interaction structure, but similar interaction 
structure w.r.t, stabilizability. 


Definition 2,4.4 


A A 

If an input homomorphism : ( S , X . ) ™ * ( Z , X . ) 

b b 

is in fact an isomorphism, then the two pairs are said to be input-equivalent . 


Remark 

A A 

If (E , Xj^) and ( Z, X^) are input-isomorphic, then 1(A) and 1(A) have 

A 

the same cardinality; in particular, if A is cyclic ( =s=> A is cyclic), then 

1(A), 1(A) are finite, d(<A|R(B^)> )=d(<A|R(B^)>) (up to a permutation) , 

A A 

d( X^)=d( X^) . However, R(B.) and R(B,) still need not have the same dimension. 
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We can dually define the concept of state-to-output homomorphism in 
a straight-forward way. 

Definition 2.4.5 

Given the system Z =(A,C.^,i£k) and Z =(A,C,^,iek) , and X . E I (A) , 

^ A 

A ^ E I (A) , we say that the two systems are output-homomorphic iff 
there exists a structure homomorphism : 

f ; (1(A), { N(C.*^,A)}^^j^, X ► (1(A), { N(cJ,&}.^j^,X 

Remarks dual to input-homomorph will apply here of course. 

Remark 

We have defined output-homomorphism in terms of observation outputs. It 
is entirely analogous to define controlled-output homomorph (i.e. in terms 
of N(H^'^,A) ) 

We now combine the input and output sides to obtain a ’system* similarity 
characterization : 

Definition 2.4.6 

Two systems Z = (A,B^,C^ ^ =(A,B^,C^ ,i£k) are input-output 

homomorphic iff there exists a structural homomorphism 
f : (1(A), {<a|r(B^)>, N(C.'^,A)} 

A ^A.A ATA, a 

(1(A), {<a|r(b^)>, n(c^ 
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Remark 


Given two systems that are both input -homomorphic and output -homomorphic 

it does not follow that the two systems are input-output homomorphic: 
the same homomorphic map has to work for both inputs and outputs in order for 
this to be true. Two input-output homomorphic systems not only have the 
same control interaction and observation interdependency pattern, but the 
same input-output transmission pattern. 

Remark 

It is obvious that the input (output) homomorphisms as defined are invariant 
under coordinate transformation (as well as input (output) transformation that 
preserves the individual control input's range space). However, they are in 
general not preserved under action of arbitrary feedback. This is so because 
the definition of homomorphisms we have used depend only on the fact that 
each controllable subspace is an invariant subspace; the internal cyclic 
structure of a controllable subspace has not been utilised. A stronger 
notion of similarity has therefore to be imposed to overcome this undesirable 
state of affairs; however, we feel that any such stronger notion ^ must at 
least incorporate the features taken care of by otir weaker notions. 

One area where the above concepts might be useful is in the classi- 
fication of laige-scale linear systems in terms of their interaction pattern. 

If any system has one of the special input structure in pp32, for example, 
then any homomorphic image of it will also have the special structure. 

Other system structural concepts, e.g. 'prime' system [M 7], decentrally 
decouplable systems (systems decouplable by only feedback modification without 
input recoinbinations) , ' non-minimal ' phase systems [D2] , etc. can be 
studied as equivalent classes of systems under structural homomorphisms 
(suitably strengthened) . 
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Another area where the above concepts might turn out to be useful is that 
of model aggregation . The traditional definition of model aggregation (see 

[A2]) is not very useful since it is too restrictive it amounts to simply 

throwing away some eigenstates (i.e, it reduces a system modulo an invariant 
subspace) , It might be useful to consider obtaining model aggregation by 
putting further constraints (yet to be identified) on a reduced homomorphic 
image of a system. 
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CHAPTER 3 


STRUCTURAL PROPERTIES OF NON-DESTABILIZING AND LQ-OPTIMAL FEEDBACK 
3. 1 Introduction 

In this ch^ter, an approach different from the previous chapter 
is taken to study the structural properties of linear multivariable 
systems under the application of multi-loop feedback. Rather than 
focusing our attention on the subspaces, we turn now instead to 
concentrate on the feedback maps. The motivation is, given a 
particular desired system property, what class of feedback maps 
can realize it? In particular, we want to know, what is a conve- 
nient characterization of a class of feedback that never destabilizes 
an originally (open-loop) stable system? that always stabilizes 
an originally (open-loop) unstable system? 

The fundamental motivation behind this approach is the recog- 
nition that the class of feedback corrputable from solving some 
LQ-optimization problem has 'nice' stabilizing properties, and that 
these properties are intimately related to the system structure. 

We therefore seek to generalize the class of feedback maps to those 
that never destabilize an originally open-loop stable system, and 
to see what structural stability properties are guaranteed by 
these more general maps. Understanding along this line will 
turn out to be extremely useful for the reliable stabilization 
synthesis problems in Chapter 4. It also allows us to generalize 
and make more transparent some of the known stability properties 
of LQ- feedback. 
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3.2 Structural properties of non-destabilizing feedback 

Our objective in this section is to identify and characterize 
a conveninet class of feedback maps that has the fundamental 
property that any meitiber of the class never destabilizes the original 
open- loop stable system. 

We begin by first recalling the standard 'I^yapunov' stability 
theorems : 

lemriia 3.2.1 (Lyapunov) 

T 

1) A is stable ( Q^O, PA + AP + Q = 0 has a unique solution 

P ^ 0) 

1/2 

if in addition, (Q ' , A) is observable, then P>0 

2) P ^ Q 0, a) detectable 

T 

and PA + AP + Q= 0 =■> A is stable 

The next lemma will provide a useful interpretation of non- 
destabilizing feedback maps later. 

lemma 3.2,2 

Let K ^ WK, where W>0, K>0. Then A is diagonalizable and has a 
real, non-negative spectrum. 

. T 

Proof since W ^ 0, it can be decomposed as W=DD for some D. Hence 

det (sl-fi) = det(sI-DD\) = det (sI-d\d) but d"^KD ^ 0, so o(Dd\) = 

CF (d"^KD) U{0) CE^u{0}. That K is diagonalizable follows from the 

fact that the zero eigenvalues are simple. 
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The ngxt lemma is a basic structural characterization of 


the Lyapunov equation. 


lemma 3.2.3 


Let A be stable , (h , A) detectable 
and PA + A^P + Hh'^ - 0 


Then N(P) = N (H , A) 
R(P) = <a'^|r(H)> 


Proof 




dt 


so X ( N(H^,A) 


r.T At 
He X = 0 


and thus N (H ,A} C N(P) 

T 

Conversely, x e N (P) x Px = 0 


X e N(H ,A) 


H^e^\[ ^dt = 0 


T 3- 

To coitplete the proof, note that R(P) = R(P ) = N(P) 

J. 


= N(H^,A) = <A'^jR(H)> 


Definition 3.2.1 

For any stable matrix A, define 
LP (A) A {k>0| KA + a\_< 0} 
and LP'’'(A) ^{K>oj KA + a \< 0-} 


C orollary 3.2.1 

if P €■ LP(A) and P ^ 0 
Then AN(P) CNtP) 

Proof (PA + a'^P + Hh’^)N(P) = 0 — PA N(P)=0 A N(P) C N(P) 
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Inportant- Remark 


LP (A) is a proper subset of the set of all positive semi- 
definite matrices (of dimension n) . The following exairple illus- 
trates the source of the difficulty; 


A = 


but KA + = 





-1 6 


1 0 


/ K - 


0 -2 


0 1 

" 


- 


-2 6 




6 -4 


> 0 


Similarly, the sum of two stable matrices need NOT be stable. 
Exan^Jle : 




A^ A^ = 


-1 6 
0 -2 

-3 6 

3 -5 


^2 = 


is NOT stable 


-2 0 
3 -3 


are both stable, but 


Since the closed loop system matrix is a sum of the open-loop 
matrix and a feedback matrix, the above remarks underscore the 
fact that it is not quite trivial to find feedback that does not 
destabilize the open-loop system. That this can in fact be done 
is the content of Theorem 3.2.1: 


Theorem 3.2.1 


Let A be any stable matrix 

Then (A + (S-w)K) is a stable matrix 

V K « LP (A) and S = -s"^, W > 0 , R(S) c R(W) 

If K < LP"*'(A), the condition R(S)CR(W) can be omitted. 

To prove theorem 3.2.1 we need the following result by Wonhanrt 
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{ [W6] , pp. 82) ; 


lemma 3.2.4 

If Q ^ 0, is observable (detectable) 

then V P = p'^^0, R>0 and V B, F^, the pair {/q+P+FRp'^,A+Bf'^) 
is observable (detectable) 

Proof of Theorem 3.2.1 

Let Q A - (KA+A^K) 
since K « LP(A) , Q ^ 0 

1 /2 

and A is stable => (Q" ,A) is always detectable 

We have 


K(A + (S-W)K) + (A -h (S-W)K)\ + -f Q - (KSK+Ks\) = 0 


If K e LP (A) , then Q > 0 
1/2 

so (Q ^ , A + (S-W)K) is observable 

=> (A + (S-W)K) is stable 
Otherwise, assume R(S) C R(W) 

3 V such that S “ VW 
(S-W)K ~ (V-I)WK 


By defining B ^ (V-I)W 


p A 0 


1/2 


We have from lemma 3.2.'i that 


( /Q+KWK/ a + (S-W)K) is detectable 
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hence from lenroa 3.2.1 (2)^ A + (s-w)K is stable 


Given Z = (A,B) with A stable , 

If U = (N-M)b'^Kx, with N = -N*^, M>0 
and K e LP(A) 

then (3.2,1) 

Bu = B(N-M)b\x 

= (S-W)K X R(S) C R{W) (3.2.2) 

Hence any feedback of the form (3.2.1) will never destabilize 
A. The following definition is convenient: 

Definition 3,2.2 

given Z - (A,B) with A stable, 

r T nvtrii T' T 

The set NDS(E) A {g R | G = (N-M)B K, M>0, N=-N 

and K c LP (A) } 

is called the class of non-destabilizing feedback of E = (A,B) , 

T T 

and any u = G x, G « NDS (E) will be called an ndsf. 

Remark 

The following interpretation of the non-destabilizing action 
of the class NDS(E) is useful. Note that from lemma 3.2.2, the term 
(-WK) in (3.2.2) has non-positive eigenvalues, while the term (SK) , 
being a product of a skew-symmetric matrix and a’ non-negative matrix, 
has all its eigenvalues , with zero real part. Thus, roughly speaking, 
the first term provides 'negative' pole shifting while the second 
term provides 'complex conjugation'. Note that the restriction 
K e LP (A) conceptually define the 'directions' of permissible feed- 
back in terms of the structure of A. It is a long-standing 'conjee- 
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ture' in the literature on 'interconnected' systems that the Lyapunov 

equation provides information on the structure of A {'k, . can 

ij 

I 

be regarded as an index of coupling between state x. and x.) 

^ D 

The next corollary is easy but has an interesting interpretation. 

Corollary 3.2.2 

Let A be stable 
If W e LP{a'’^) 

then (A-WK) is stable V K 0 

Proof W » LP (A*^) => (a'^^-KW) stable V K^O 

(A-WK) 


lemma 3.2.5 

Let A be stcible 

Then 

(1) e lpca), p^ * 

V ’ ^ 2 ^ 

(2) P e LP(A^), P € LP(A2) P t LPCttj^A + a^A^) 

V cc^^>0, a2>0 

(3) P e LP(A) pc LP(A+(S-W)P) 

V W>0, S=-s'^, R(S}CR(W) 


Proof 


CD 

(3) 


, (2) straight- forv-ard 
We have 


P(A+(S-W)P) + (A+(S-W)P)^P = PA + A^P 


< 0 


2PWP 
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We next give an example to illustrate the content of Theorem 
3 . 2.1 


Example 


given E = (A,b) , suppose 3 a basis such that a is of the farm 



Then any K of the form; 



is a meirber of LP (A) , 

and any feedback of the form u= - ' ndsf. 
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This exan^le can be generalized as follows ; 


Let K = DD >0, h stable 

If D A = for some A symmetric 

Then K€LP(A) 

T T T A >^T T T 

Proof DD A + A DD = )D = 2 d£d < 0 

sxnce (t{A) c <^(A) and A = A 


The class of ndsf identified in Theorem 3.2.1 can be further 
generalized. 


lemma 3.2.6 

Let A be stable. 


T 

(H ,A) - observable, and M>0 


Then 


“1 i/\ fP 

(A + P H(M + N')H ) is stable { 

l, /vT T 

M < M, M = “M , N = -N 

where PA + a'^P + = 0 ( 


Proof 

T 

(H ,A) - observable =s>-P>’ 0 
from (3.2.4), we get 

P(A + p'^HCM+NjH^) + (A+P"^H(^ + N)h’*’)P + H{M-2^^)H^ = 0 
so M<jM ^ H(M-2 M)h'^> 0 

and (*\/a (M-2$)H^, A + P ‘^H(M^N)h'^) - observable 

thus by lemnia 3. 2. 1(2) , (3.2.3) is true 


The dual of lemma 3.2.6 is inportant enough to be stated as 
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3.23) 


3.2.4) 


theorem. 


Theorem 3.2.2 


Let A be stable, (A, B) -controllable, M>-0 
Then {A + B (fi+N) is stable (3.2.5) 

V 9 . N - and Pa'^+ AP + = 0 (3.2.6) 

Remark 

T -1 

Since the eigenvalues of B(M + N)B P all have rionnegative real 
parts, (3.2.5) can be loosely interpreted as identifying a class of 'positive^ 
feedback that does not destabilize A , and hence provides a sort of 
'stability margin' characterization of A, Note that (3.2.6) can be rewritten 
as 

-1 T “1 T -1 

P A + A P + P BMB P =0 

or P ^5 LP(A) 

Thus (3.2.5) is of the form (A + (S + W)K) , (3,2.7) 

with KCLP(A) and W suiteible restricted as defined in Theorem 3.2.2. 

In this sense, (3.2.5) is a generalization of ndsf. 
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£.3 Structural properties of LQ-optimal feedback 

T 

It IS well-known that, given SD(A.B.H ) and Q>0, KX) (Q,R of 
appropriate dimentions) , a unique, positive semidefinite solution matrix K 

exists to the algebraic Riccati equation: 

T -IT T 

KA + A K - KBR B K + HQH = 0 

moreover, the closed loop system 

X = (A -BR ^BK)x is stable (3.3.1) 

and N(h'^,A)=0 K>0 

T 

We will denote the ui,ique K as K(A,R,H ,R,Q) 

The Linear Quadratic Optimization interpretation of K is that 
-1 T 

u* = -R B K X 
is the solution to: 

min f(x*’Qx-f u*'^Ru)dt (3.3.2) 

ueli ^ 

subject to X = Ax + Bu , x(0) = arbitrary 

z = H X 


Structurally, the use of Q and R is equivalent to applyting the 

_Jk T T ^ 

maps: B»^BR H i^Q H . For let '(i = r'^u, ^ = Q s. Then (3-3,2) is 


equivalent to the problem: 

min j?v)dt 

ueU 


subject to 


X = Ax + (BR^)'Q 

(q^h'^)x 


Thus any LQ-problem can be reduced to one with Q=I, R-I by appropriate 
input and output transformations. Note that if the input u is to be regarded 
as a direct sum of u^ , i < k then the only transformation R that preserve 
the invariance of theu^’s are those that have the (appropriately 

dimensioned) block diagonal matrix representation. In what follows we 

-k TUT 

will asstime that such an initial transformation B« — ►BR , has 

already been made, so that Q = I^, R = l^, unless otherwise specified. We 
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T T 

will then abbreviate K{A^B,H ,I #I„) to siit^jly K(A,B,H ) . Note that the 

p tn 

notation K(A,B,H^) will always mean that , and hence K will 

always be unique and well-defined. 

We first note the following basic structural characterization of 
the Riccati equation: 

Lemma 3.3.1 

Let K “ K(A,B,H^) 

Then N (K) =N(H^,A} , R(K) = <a'^|R{H)> 

Proof A direct generalization of lemma 3.2.3. 

This result state that the Riccati equation can be reduced by restricting 
to (X/N(H^ , A)) - 
Lemma 3. 3. 2 

<TtA - BR ~^b\] D ff'A|N(H'^,A)) Utr(A) 

where PA = ^ , P: X ►X and X = X/ ( <A |R(B)>f N(H*^,A) ) 

P = canonical projection 

Proof see [K2] ; the above is a mere translation into geometric terms. 

Put simply, the uncontrollable and unobservable poles of A are 

not moved by the LQ-feedback. Conversely, if any eigensubspace is 
T 

observed by H , then the corresponding pole is shifted. 

Lemma 3.3. 3 

Let K = K{A,B,h'^) 

Then p'^KP = K {p“^AP, P“^B, h'^P) 

V (n X n) - nonsingular P 
Proof Straight-forward. 

Lemma 3. 3. 4 

Let G = -B K, where K = K(A,B,H ) 

Then NtH'^,A} = N(g'^*,A) 
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Proof 


T* 

N{G ,A) 3 N(K) = N(H ,A} 

Conversely, (KA -f a\ - KBb'^K + Hh’^) N (g'^*,A) - 0 
H^N(g'^*,A) = 0 

h'^A^(G*^ ,A) =0 , k=0,l,... 

thus N(g'*^*,A) C N{H^,A) 


Lemma 3.3.4 result has a single interpretation: given a B such that 
(A,B) is stahilizaBle , KB is such that ({KB)'^,A) is detectable (more 
precisely, ca'^|KR(B)>- =<A^| R(H) )>) 

T 

Our next result shows that in the special case N (H ) = 

T 

N(H ,A) ^ 0 , the Riccati equation can be solved in a smaller dimension 

in a str?ight forward way: 

Theorem 3.3.1 

Let N(h'^) = N(H^,A) and has full rank (i.e. is epic) 
and K = k(a,b,h'^, r,q) 

Then K = 

where 9 : ~ I , R,Q) 


Proof 


N{K) = N(h'^,A) = N(H^) K = for some K>0 

from KA + a\ - KBR^^B^ + = 0 

we see that 

A T Ta at - 1 T TV^ T 

HK(H A) + (HA) KH - HK(H B)R (H B) KH + HQH = 0 

now N(h'^) = N(h'^,A) 3 ^ S.t. h\ = 

T A T T 

since H has full rank, A is even unique, and = H AH(H H) 

We therefore have 


A A A A A A — IaTa T 

H(KA + AK -KBR B K + Q]H = 0 


A T 

where B = II B 
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A 

Hence if K is the positive definite solution to 

A,> AfPA Aa _1a<T1a 

KA + A K “ KBR B K + Q « 0 

A <p 

Then HKH will satisfy the higher-dimension equation, and since K is 
unique, K = 

Remark This result has a natural interpretation in terms of the concept 
of aggregation . Given the system 

X = AX + Bu 

T 

define the aggregation vector 2 ~ H x. Then z satisfies 
z =5 Az + Bu 

iff N(H^) = N(H^,A), or equivalently, AN (H^) C N(h'^) 

aT T 

Note that A is just the matrix representation of A I i'(H) : i.e. the 

(A,B) model is just the model (A,B) modulo N(H ). (If ( X,H ) is an 

(eigenvalue, eigenvector) of A, then ( ^ , H x ) is the corresponding 

pair of A if / 0) . 

Remark Note that u* can be written in the form 
u* = Fh'^x “ Pz 

Corollary 3.3.1 

u* is output feedback iff N (H*^) - N(H*^,A) 

T T 

Remark In the general case N(H ) N(H ,A) / 0, transformation to a 
'cannonical* form is needed to achieve the reduction. See [K2], 

T 

Remark By taking H to be (1 x n) - (left) eigenvector of A, one has 
a case of single pole placenvent. 
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We next consider the problem of parametrization redundancy in 
LQ-optimization. Given an LQ-problem data SD(A,B,Q ), denote the corresponding 
(unique) optimal feedback gain matrix as (G ) ( u =G x ) . It is well-known 

rj\it 

that the map (A,B,Q) > — * G is NOT injective with respect to the parauieter 

space of I Q = Q^€R | Q>0,D(Q^,A)| . The precise statenvent is 

as follows : 

Lemma 3,3.7 

Given FD(A,B,Q*^ ) , 
if (A,B,Q^)I— ^G^* 

Then (A,B,Q)I — ►g'^* 
where Z = | Q « R 
moreover, if RK(B) = 
cone of R 

Proof This follows from a straight forward generalization of Theorem 7 in 
[M5] and hence is ommitted. 

Corollary 3,3.2 

I nxn T T T 

Q€R I Q+(A + BG)Y+Y(A+BG)=0, Y>0 

N(Y) D R(B) and V G^ s.t. (A + Bg’^) is stable I 

Next, we show that under certain conditions, addition of 'actuator 
dynamics' does not alter the original feedback solution, but merely appends 
extra actuator state feedback: 


V Q « i 

I Q = a'^Y + YA + Q>0, Y = Y^ and YB 
m, then H is an 


(n -m) (n - m t 1) 


of 

dimension 
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Leimna 3.3.8 


Then 


Proof 


Let K = K(A,B,H ) 

Let A f R , B € R , H(R be such that we have 


SD 


p. “],[;]) 


nxm 


If P€ R 


r p'^Kp p^K 1 

Lkp k J 


solves AP - pS “ B 

A 

PB = B 


T 

HP = H 


= K 



(3.3.3) 

tH^, h'^1 \ 

f ' 

(3.3,4) 

T ^ 

H .AB = H BB 

(3.3.6) 


See pp. 63. 


The next theorem shows the condition under which a Riccati solution can 
be decomposed as the sum of two other Riccati solutions. 

Theorem 3.3.2 

Let = K(A,B^,H^^) , i=l,2 


and K - K( A, 

w 

Then K = if 


or equivalently / 


R(B^) C Nm^ ,A) 

R(B2) C N(Hj^^,A) 

<a|r(Bj^)>C 

<air(B2)>C n(h^'^) 


Proof 


We have K^A+A^^iq^ “ ° 


, W. = B.B. 


T 


Adding, we get ; 
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If K.B,=0 , i^j , then the above reduces to 

(K^+K2)A + a'^CK^+K^) - (Kj^+K^) (W^+Wj) (Kj^+Kj) + (H^H^ + " ° 

Hence K = by uniqueness . 

Now R(B.) C N(K ) ==> R(B.) C N(H,’’;A) 

1 j X J 

== > Hj\cB^} =0, ..., H^'^A*^“^R{B^) = 0 

===. > <A|R{B^)> C N(H^'^) 


- 62 - 



Proof of liemina 3.3.8 


K = K(A,B,h'^) 



From Lemma 3.3,3, 


= fp^KP KP 


P K K 


0 A 


It is easy to check that (3.3.3) and (3.3.5) ====> (3.3.4) . The necessary 

condition (3.3.6; follows by trivial manipulation of (3,3.3). 
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3.4 Structural Stability Properties of LQ-fee<3back 


I 


In this section we conibine the results of 3.2 and 3.3 to obtain 
gereralizations of knovm stability properties of I^-feedback as well as to put 
them in new perspectives and greater transparency. 

We begin with 
Definition 3.4.1 

Given S(A,B), let 

l4Q(A,B) = I P^O jp = K(A,B,H^) for some (H*^,A) detectable | 

(3.4.1) 


We will call the set LQ(A,E) the class of LQ-solutions, and the feedback 
u = - r”^b'^K (3.4.2) 

an LQ-f eedback . 

-1 T 

If K€LQ(A,B) then of course (A-WK) is stable for some W =BR B . The next 
lemma is trivial to show but has important consequences. 
lemma 3.4.2 

K c IiQ(A,B) ===> K « LP( A-BR"^b\ ) 


Proof 

Obvious from the Riccati equation 
Important Remark 

**1 T 

For an unstable A, given any K such that ( A-BR B K ) is stable, in 

—1 T 

general it is NOT true that K c LP (A-BR B K) . 

Example 

■ [: :] 
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Then 


-1 T 

A - BR B K = 


-1 3 

0 -1 


is stable, BUT 


-IT -ITT 

KCA-BR B K) + (A-BR B K) K = 


hence K / LP (A-Br’^b'^K) 


-2 3 

3 -2 


^ 0 


The importance of lemma 3.4.2 is that it shows that such an unfortunate 
state of affairs CANNOT occur if K is an I^)-solution. It is this distinguishing 
property of LQ(A,B), together with that of ndsf that is responsible for the 
following generalization : 

Theorem 3.4.1 (Infinite Gain Margin Property) 

Let K e LQ(A,B) 

Then ( A - (B(N4-’t~^)B^ + '&fN+M)^'^)K ) is stable (3.4.3) 

V R, N = -N^, M>0, '^^= -'n'^ , 'S' arbitrary (3.4.4) 

Proof 

since K ELP (A-Br”^b\) 
we have from Theorem 3.2.1 that 

(A - Br"^b\ + (S-%)K) is stable , S=-s'^, R(S) C R(W) 

Take - B (R”^ - r“^) b"^ + with 'fe<R, M^O 

I 

and S=BNb"^ + with N^-N*^ , and 

The result follows. 
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Corollary 3.4.1 


If HH >0, then the condition (3.4.4) can be relaxed to 'k>R (3.4.5) 

Remark 

For ^ = 0, theorem 3.4.1 is a generalization of the infinite 

gain margin property of LQ- feedback for single-input, single-output 

systems first noted by Anderson & Moore [Al ] , who showed that the 

T IT 

feedback gain vector g = b K can be multiplied by any scalar 
a 1 without destroying stability; the proof he used involve 
classical Nyquist techniques. Theorem 3.4.1 not only generalizes 
this property to multi-input, multi-output system, but allows 
more complicated alterations of the feedback gains; moreover, it 
makes the proof of this property much more transparent. 

Remark 

For '^7^0, theorem 3.4,1 allows for changes in the B matrix 

(e.g. if N=%, 1 j=M, then the change in B is: B — » B + :§) without 

destroying stability. One useful interpretation is that the optimal 

gain computed for one nominal remains stabilizing when B^ get 

perturbed so long as the change in B can be represented by those 

allowed in theorem 3.4.1. For example, let B — ► B.+B . Then 

^ o 1 o 

"1 T T 

the feedback term becomes B.R B + B R B . If B. = B {f}+ft)R 

1 o o o 1 o 

T 

for some ^ = -f) , fl>0, then the system will remain stable. More 
complicated cases are allowed. 

Alternatively , the case ^ 0 can be interpreted as allowing 
for the possibility of imposing extra controllers, and using these 
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extra feedbacks to 'tune' the closed-loop behavior of the original 
system. Then theorem 3,4.1 says that so long as such tuning has the 
feedback form allowed, the stability of the closed-loop system will 
not be destroyed by such additional 'fine-tuning'. 

The inverse of the infinite gain margin property, i.e. how 
much the feedback 'gains' can be reduced without leading to insta- 
bility is answered by the next proposition: 

Theorem 3.4.2 (Gain reduction tolerance property) 

Let K E LQ(A,B) 

Then (A - B (6 .“^+N)b'^K) is stable (3.4.6) 

V 0 such that 6 ^ and any (3.4.7) 

m 2 

T 

If HH >0, then the condition (3.4.7) can be relaxed to 

(3.4.8) 

Proof 

Let A (A - B(I&“^+N)B^K) 

from the Riccati equation 

T -IT T 

KA + A K - KBR B K + HH =0 

we get kS + + KB {2fi”^-R"^}B\ + = 0 

T 

hence from lemma 3.2.4, 3.4.6 and D(H ,A) 

(\/kb( 26 .“^ - r“^)b\ + £) detectable 

and lemma 3. 2. 1(2) => S is stable 

T T 

If HH >0, then (H ,fi) is always detectable, and stability 
of K follows from (3.4.7) 
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Reinark 


This is a generalization of the Jmown 'stability margin 
property', or gain reduction tolerance property of LQ-feedback, 
The interpretation is most transparent in the special case p'"^= 

diag (a^^, ^ = diagCa^., 

the original individual LQ- feedbacks are of the form 

T> 

u. = -a.b.K i=l, k 

X 1 1 

The theorem says that in t?iis special case, the system remains 
stable if the feedbacks are altered to: 

u, = -a.b .K 

X XX 

so long as a. > -~ a. 

More complicated cases are allowed by the theorem. 

Remark 


As is clear from the proof, neither the condition (3.4.7) 
nor (3.4.8) are necessary. 

By ea^loiting lenana 3.2.6, we can further generalize Theorem 

3.4.2. 

Theorem 3.4.3 

Let K € LQ{A.,E) and K=K(A,B ,R,h'^,Q) where (H^,A) is observable. 
Then (A - B(ft'^+ N)b\ + K~^H(0+^)H^) is stable 
V ft>0 such that ^ ^ 

and V S = such that 0"^ Q 
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Proof 


“X T 

Let K = (A-BR B K) , which is stable 
Then 

+ KBR"^b'^K + 0 

kA + + [KB,H] r r“^ 


^ -1 T -1 

R 0 B K 

T 

L 0 qJLh J 


= 0 


Thus by lemma 3.2.6, the result follows. 


Remark 


Although this result has no easily interpret able physical 
applications, it is suspected that it may be a ! time-domain ' state- 
space version of the ‘phase margin' property of LQ- feedback, a 
property first characterized by [Al] for single-input, single- 
output n2-feedback system using Nyquist techniques. (In [Al] 

it is shown that a single-input LQ-regulator has a phase margin 
of at ie.ast 60 degrees.) Recalling the importance of phase margin for 

time - delay tolqirance., this conjecture, if true, would- further illustrate 
the structure of LQ- feedback. 

Remark 


The observability assumption (rather than just detectability ) 
is only used to guarantee K>0, and hence the existence of K 
This assump-‘ 'on can be removed by the use of generalized inverse 
(in lieu of K and hence is not essential. 
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CHAPTER 4 


SYSTEM RELIABILITY SYNTHESIS 

4.1 Failure Modes in Control System. 

In this Chapter we study the problem of designing reliable feedback 
control system and state reconstructors (or observers) and Kalman filters 
subject to control input and observation sensor failures. 

The general class of system reliability synthesis problems is little 
researched in the context of system control design. The only previous work 
on this subject which the author is aware of are those of MoFarlane, 
Belletruti [Ml] , [B3] and also Rosenbrock [R4] . However, the investigations 

of these authors were conducted in the frequency domain and involved 
heavy use of the Nyquist criteria and related techniques. (What we will call 
the reliable stabilization problem (ESP) was referred to by them as 'system 
with high integrity problems',) 

We will take an approach here that is very different in concept as 
well as method. Our investigations will be entirely in the time-domain 
state space, and we will ejcploit the concept of non-destabilizing feedback 
maps and other structural concepts in our problem formulations and solutions. 
In so doing, we will be able to provide an indirect partial solution to 
a long-standing problem in reliable stabilization synthesis, which in the 
next Chapter will be extended to solve a related coordinated decentralized 
stabilization problem. 

Before we present the technical problem formulations, we first briefly 
review the context in which failure occurs in a control system. 

We consider a general model of a tracking-regulator control system 
as sketched in Fig. 4.1 

- 70 - 



“1 



Fig, 4.1 




What we have labelled 'compensator' could well have been called an 


'information processor' since in real world situation it may be the model 
of something ranging from a simple electronic circuit to a minicomputer, 
and whose function is simply to compute a control input signal from the 
(feedforward and feedback) sensor signals. The map {or control strategy) : 
(sensor inputs) — ► (control signal) is usually fixed by the instrumentation 
(i.e. non-adaptive control) . Prom a design point of view the compensator 
can be decomposed into several distinct functional devices; one version 
of such conceptual breakdown is shown in fig. 4.2, (See [Fl] , [Dl] ) 

For the purpose of failure analysis it is convenient to single out 
the following 'st±>system' modes of failure: 

1) plant system failure 

2) control actuator system failure 

3) sensor system failure 

4) compensator system failure 

5) command generator failure 

Note that, physically , the signal processing in the compensator operates 
on a different energy 'level' than the plant variables (and perhaps the 
command generator) ; the control actuators and observation sensors are the 
physical transducers that converts signals at one energy domain to the 
other. As such, the physical causes of failures are usually different for 
ui'.e different component systems. 

It is usuaJ.ly the case that the plant and command generator systems 
are 'given', as far as the control engineer is concerned, and hence when 
failures in such system occurs (e.g, alterations of the plant dynamics, 
cutting of the command input channel) nothing can be done except repair, etc. 



I 

OJ 

f 



COMPENSATOR 
SYSTEM 


Fig. 4.2 




similarly, as far as the control engineer is concerned, the component 
reliability characteristics of the other subsystems can also be regarded 
as given. The task of the control engineer, rather, is that of the following: 
given instrumentation components of fixed reliability characteristics, 
what is the best control implementation scheme that not only achieves the 
desirable system performance when all components are functioning normally, 
but that is also such that, when certain instruments (sensors, actuators , etc. ) 
fail, the resultant performance deterioration will in some sense be minimized? 

In particular, from the control system point of view, the most critical 
criterion that any reasonable control design must satisfy is that of the 
controlled plant's stability: when possible at all, the control strategy 
ought to be such that any failure in the control instrumentation never 
destabilize the plant. This is especially in those common situations 
where tha stabilization of an originally unstsible plant is the primary 
function of the control design in the first place , 

Unfortunately , existing (time domain} multi™ input control design 
techniques (LQ-optimization, pole assignment, etc.) do not have this desirable 
property. The reason for this is intimately related to the fact that, in 
such design techniques, all the feedback loops are 'simultaneously' determines 
rather than individually 'shaped', and the designer has no direct control 
over how the overall stabilization job is being 'distributed' among the 
various feedback loops. Indeed, it is clear that the problem of synthesizing 
reliable stabilization is related to the problem of being able to individually 
adjust the feedback loops without interfering with the stabilizing action 
of other loops. 

Because of its fundamental importance , we will concentrate our 
attention in this Chapter on the reliable stabilization problem and its 
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natural dual, reliable state-reconstruction (or reliable Kalman filter 
design) . This means that we will concern ourselves with the simplified 
'regulator* model as ahown in fig. 4.3. 

The two failure modes we now identify are 

1) control actuator input channel failure, which is equivalent to the 'cutting' 
of a feedback loop. 

2) sensor output channel failure, which is equivalent to the 'cutting' of a 
driving input to the state reconstructor (Kalman filter) . 

For convenience we will analyze the problem of reliable plant stabili- 
zation and reliable state reconstruction separately, since it will be obvious 
how the two can then be considered together. This allows us to replace what 
is properly a feedback of the state estimate (generated by the Kalman filter) 
by the state vector itself, 'as if there is direct feedback. The analytic 
consequence of doing so is well known (so long as the state constructor does 
not fail) and will not be elaborated; we will simply summarize by saying that 
this just amounts to ignoring an extra driving term (state estimate error) 
which decays away and thus has no effect on the closed loop plant stability 
analysis . 

Note that actuator failure of the type that does not lead to zero 
actuator output but rather to such phenomena as 'getting stuck' at a non— zero 
bias, or saturation effects can be modelled as a feedback loop cut plus the 
injection of a non-zero bias driving term; so long as plant stability is 
ensured the steady state consequence is easy to analyse. Similar remarks 
apply to the analysis of actuator failure consequence on tracking and 
disturbance rejection performance. 

A final introductory remark is in order. The reliability synthesis 
problems we are concerned with can best be described as 'operational' 
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reliability that is automatically guaranteed throughout the system operation 
without any 'outside' intervention, hximan or otherwise. Clearly, such 
additional 'adaptability' can be seperately considered, e.g. the design 
of failure detection system which can produce diagnosis signals to human 
operators who can then intervene by resetting the various loop gains and 
effecting repair, etc. The critical inportance of our 'operational' 
reliability analysis lies in the fact that it automatically ensures that 
the plant does not get irreparably damaged be destabilization in the inevitable 
period of delay before such intervention can be effected. In this sense, 
a reliable synthesis is 'robust' against arbitrary failures. 
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4.2 Reliable Stabilization under feedback loop failures 


Given the system 2 = i £ , let the feedback law employed 

by the i^^ controller be ; 

u^ = , i E k (4.2.1) 

Subject to these multiple feedbacks, the resultant closed-loop system 
becomes : 


X = ( A+ 2 ) X (4.2.2) 

iek ^ ^ 

Let the G, 's be chosen such that (4,2.2) is stable, i.e. all the feed- 
1 

back loops together stabilize A, If now a subset I C of the control 
feedback loops are somehow broken, the resultant closed- loop system become® 


( A + E E.G."^) 

■..IT 

lE]^I 

which in general need no longer be stable . 

T 

Conversely, given that { A + 2 b.G.T) and ( A + 2 b.G. ) are stable, 

iEIj ^ ^ i£l2 ^ ^ 

where I n I., = 0 , the combined system ( A + j; B.G. ) need NOT be stable. 

What we would like to have, from the viewpoint of reliability, is a 
multiple- feedback loop stabilization scheme that, not only ensures stabilization 
when all the feedback loops ate fmctioning, but that ensures stabilization 
even when an arbitrary number of the loops fail. The problem is not trivial 
because just ensuring that the individual feedback systems: 


( A + B.G. ) 

1 X 


i e k 


(4.2.3) 

are stable is not enough; superimposition of such feedback loops can 
destabilise the collective system (4,2,2) . ( Examples demonstrating this 

fact will be given later.) 

We are therefore led to formulate the following class of problems : 
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I^liable Stabilization Problem { RSP ) 


Given E“(A,B,,i€k) e;r’^x...x ^ characterize the set 


RS 


( S ) “ { ( G r . . • / Gj^ ) 


e R 


.m-ixn 

' X . . . X R K 


V I C k, I > 1 


( A + B.G.^) is stable } 

X X 


(4.2.4) 


Remark 

T T 

In words, if ) e RS( I ), then any combination of the 

T 

feedback loops ~ x will result in a stable system; conversely, 
with all the loops applied, breaking any number of the feedback loops will 
not destabilize the system, so long as at least one loop remains. It is this 
second interpretation that motivates us to call a member of RS ( Z ) a 
reliable stabilization . 

Remark 

By substituting C? ^-assignability for stabilizability , we can analogously 
define other assignability-reliable problems. 

Lemma 4.2.1 


RS( I ) ^ ^ only if ''^'*'(A)C < A | R(B^)> 


i.e. A is individually 


stabilizable. 
Proof Obvious 


Let S denote the set of all Z such that Z is individually stabilizable. 
Then lemma 4.2.1 means that we need only consider Z e: S as far as RSP is 
concerned. Is the converse also true for at least some Z E S ? 

The following special cases can be dispensed with right away : 

Lemma 4.2.2 

Z = (A,B^,i € k ) E S, d( ) _< 1 RS ( Z ) 0 
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Proof 


If d(X^(A)) =0 then G^=-..=Gj^=0 is clearly a solution to PSP. If d(X^(A))=l, 

take N(G^ )=X (A) and such that {A+B^G^ ) is stable V i ek. It is clear that 

this ===> (A+ E B.G.'^) is stable V I C k, |Il >l . Hence all such (G. ') . . 

.,,1 X — 13- eii 

< C j- 

are members of RS ( I ) . 

The class of BSP solutions we are interested in fif there are any) are 

T — + 

therefore those that have N(G^ ) 7) X (A) or dimension of X (A) greater 

than one. More generally, we ask, is 
RS ( I ) (2T f or ^ S e S ? 

A direct attack of this question using the 'geometric' tools appears to 
be difficult. We shall now show, however, that the question can be resolved 
by an indirect approach. The key idea is to ejiploit the fundamental properties 
of ndsf and LQ-*feedback maps. 

The following conceptual re-interpretation of BSP is useful. Since the 
BS property will not in general be satisfied if the G^'s are arbitrarily 
independently chosen, it is clear that solving BSP involves finding a 
suitable class of restrictions on the individual freedoms of the 
of finding a suitable parametrization of the ’coordination' constraints 
on the individual controller's feedback map to achieve RS . 

In this spirit, we have 

Lemma 4.2.3 


Let A be stable 


If G. 

X 

, i^K 

XXX X — 

(4.2.5) 

where 

T 

N. = -N. , M, > C are arbxtrary, 

X X X 

(4.2.6) 

and 

P e LP (A) 



P. £ LP.(A) and P.R(B.) =0 i / j 

X X ;] 


Then 

(G^^, G^) e RS( E ) 
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Proof 


Prom lemma 3.2.5 and Theorem 3^2.1 we have 

(A+( S (P+ EP^)) is stable ^ C K 

» •' * 

and (4.2.6) =?» (A+ S (N^-M^)B^’^(P4'P^) ) stable I C K 

Remark 

T 

The choices may be interpreted to be 'coordinated’ by the specification 

of P (fixed for all i e K) , so that RS is guaranteed, while the condition 
P eLP(A) means that every P e LP (A) can coordinate the system to achieve RS. 

Remark 

The conditions (4.2.6) CEin be replaced by ^ R(M^) 

Lemma 4.2.3 has identified a class of feedback maps that never destabilizes 

an open- loop-stable system in every possible combinations, i.e. the feedback 

loops can be independently shaped wirhin the constraints imposed. 

The condition K.R(B.) = 0, i?^j has the interesting interpretation of 
^ 3 

interference avoidance , i.e. if K^,K 2 6 LP(A)and (A-W^K^) and (A-W 2 K 2 ) are 
both stable, then (A-W^K^-W 2 K 2 ) is also stable ^ either Kj^R(B 2 )=D or 
KjRCB^j-O . 

We next seek to extend these intuitively pleasing properties to the 
case when the open- loop system is unstable. 
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Theorem 4.2.1 


Given £ = (A,B^,i eK) e S 

suppose 3 K ^ 0 such that for some M.^0, N, 

X 2 

i E K 
T 


-N, 

X 


(AfL^K) is stable 


where L, A B. {N.-M. )B. 

X — X 1 X X 

and K e LP{A+L^K) 

T T A T 

If G. = (N.-M.)B. K t (N.-M.)B. K. 

1 XXX XX XI 

A A A >1’ 

where > 0, = -N^ are arbitrary 

and K. £LP(A+L.K), K.R(B.) = 0, 

^ ^ i 3 

Then (G^^, ..., Gj^^) £ RS ( S ) 


Proof 


(4.2.8) =■> (A+ Sl.K) is stable ICK, 1 I I 
iEl 1 I I 

and (4.2.9) => K. £LP(A+ El.K) 13-14 

1 jEl J ' ' 

=> (A+ SL.K+ ZL^.K.^ is stable 

j£l 3 jei 3 ? 

A Ak A T 

where L. = B.{N.-M.)B. 

X XXIX 


(4.2.7) 


(4.2.8) 


(4.2.9) 

(4.2.10) 


Remark 

The condition (4.2.9) can be replaced by M^>0, R(N^) C R(M^^) 

Remark 

Recall -that the condition Z e s is necessary for RS { Z ) . ^ 0, and hence 
is not a restriction at all. 


Remark 

The ’coordinating parametric space' is now the set of all K > 0 that satisfies 
(4.2.7) and (4.2,10). Notice "that once such a K is found, each control input can 
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I 


generate {'shape') its own feedback loop independently so long as it rejspects 
the conditions specified by (4.2.9) and (4.2.10). 

In order for 'Theorem 4.2,1 to be nonvacuous , v/e have to assure that there 
exists K> 0 that satisfies (4.2,7) and (4.2,8). For the case when A has only 
one unstable pole this is trivially true. 

Corollary 4.2.1 

If d( X ^(A)) =1 then any K ^ 0 and R(K) - X ^(A) satisfies (4,2.7) 
and (4.2.8) . 

Proof 

Projecting into the unstable subspace, we have a one -dimensional system, 

hence K | X (A) > 0 clearly satisfies (4.2,7) and (4.2.8). 

4* 

For d( X (A)) >1, the situation is much more conplicated. However, the 
following is true: 


Corollary 4.2,2 

T + 

Let P : X — ►X (A) be the canonical projection, let 

T ' T T 
P A = AP , P B, = B. 

1 1 


If 


a 


K ^ such that 


A. = (A+B, (N.-M.)B. K) is stable i ek 
1 1 i 1 1 — 

and K £ LP(A.) 

1 

then K = PKP^ satisfies (4.2,7) and (4.2,8), i.e. 

A, = (A+B . (N , -M. ) B , ^K) is stable ie k 
1 1 1 1 1 — 


and K e Lp(a^) 


(4.2.10) 
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Proof 


This is a 'standard' geometric trick. A is just A reduced modulo the 
stable subspace; since the feedback map defined in (4.2.10) affects only the 
unstable subspace, leaving the stable subspace invariant, stability of 
implies that of A^. 

Remark 

The inportance of this elementary result is that it shows that the 
'coordination parametric space' can be reduced to just that part of the individual 
feedback maps that affect the unstable subspace - if the unstable subspace can 
be coordinated to be reliably stabilized, so is the whole state-space. 


liecalling the stabilizing properties of LQ- feedback, we are motivated 
at this point to consider again an indirect approach to finding the class 
of K > 0 that provides ES coordination. More precisely, we formulate 
the following class of problems : 


Reliable LQ-Stabllization Problem (RLQP) 

Given S = i £ h) e S 

T 

find conditions on H , R^> 0 such that (if possible) 

T* -1 T T r R- "1 

= -R^ K, where K*K(A, ... , ) 

^^k 


satis ^ the reliable stabilization property, i.e. such that 




k 


£ RS(S ) 


We will call a Riccati solution K that solves RLQP a RLQ solution 
for short. 


- 84 - 



Remark 


T* 

The problem here is to start with some (G^ that always guarantee 

T* 

that (A + 2 B.G. ) is stable, but which may have any of the (A-t 2 B,G. ) , 

.* l x 11 


I C K, I >1 unless suitable constraints are inposed. 


iek 


Remark 

The solution of this problem is of great significance by itself since, 
when possible, it allows a single LQ-feedback solution to automatically have 
tne reliable stabilization property. We have already shown in Chapter 3 
that LQ- feedback remai.ns stabilizing under fairly general alterations in 
the actual gain iitplementated; if we can structurally ensure reliability 
synthesis automatically in LQ-feedback too, then we will have substantially 
increase the usefulness of the LQ-method as a stabilizing design technique. 


Remark 

T 

A parametrlzatxon of the HH >0, R>-0 that gives rise to RLQ will 
provide new significant interpretation of LQ-optimization in terms 
its role as providing 'structural' coordination. 

We begin with the following partial characterization of RLPQ: 


Lemma 4.2-4 


Given ^ = (A,B^, i e ) £ S 
T 

Let CH / A) be detectable, 




0, Q>0 


and K = K{A, [B^, , Bj^] , H , R^, Q) 


-1 T 

let W. = B.R. B. 

X 1 X 1 
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Then sufficient conditions for 
(A - . ^ W.K) to be stable 

1 0 X X 
ICK 

I 

sre: ^ detectable 

where = HQH^- K( I . W. )K 

ieJc-I 

Proof 

We have KA+a\“K{. Z W.)K+HQh'^ = 0 
XEK X ^ 

let = (A - W.K) 

then KA^ + aJ^K -fKdWjK + Q =0 
I I ■. ^ I ■ 

x£^ 

y 

Hence > 0 and (Q^* , A) - detectable is sufficient for A^ to be 
stable by lemma 3.2.^, 

Bemark 

Since the conditions (i) and (ii) of Lemma 4,2.4 can ohly be checked 
after the Riccati solution K has been confuted, it is of little t>ractical 
use. 

Remark 

A necessary condition for Q > 0 is that R(H) D K g R(B.) 

T ~ i ^ 

Hence if we have D(H ,A) but d(R(H))< d( Z R(B.)} , 

Then Qj 2 l 0 will never be satisfied. 
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Corollary 4.2,3 

Let P:X — X^(A) be the canonical projection 

and denote = PB. 

1 1 

If R(B^)C ...CR(Bj^) (up to a permutation) 

Then RLQ()^ ) 0 


Proof 


^ A A 

Let L - (a,B^, i< k) be the aggregation model of I modulo 
X (A), Since X (a) = A |R(Bj^)>we can always find a LQ-solution K 

. ^ ,at a^ a a a a X* 

for some Mj_>0 t and D(H ,A) such that (A-B^M^B^ K) is stable, 

A , A 

Since R(Bj^) c R(B^) i =2 , k, it is clear that 

0 can be chosen such that 

AA^m AAAifk 

B.M.B. = B.M.B/ + W. 

Ill i i 1 1 

for some W. >0 


Hence from Theorem 3,2.1^ 

(A- .2 B.m.B.K) is stable V ICk ll|> 1 

1 E I 1 1 1 — 

Then from Corollary 4,2, RLQ ( S ) = 0 
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That RLQP is not vacuous even for ^ = (A,B^ with totally 
+ 

unstable (i.e. X (A) =X) is shown by the existence of examples like 
the f o 1 lowin g ; 


Example 


A = 





Take R^=R2=1 


Then K 


ri2.5 -7" 

L-7 5 . 


e lOliQ { j^) 


The question of interest is therefore; Is RI^ {!) 7^ f6 V 2 eS ? 
Unfortunately, this remains at present an unresolved question. 
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We now look at some simple numerical examples. First consider the 
simplest possible case : one-dimensional state-space 

Example 1 

A = [a] , a > 0 

Bi = B 2 = Hh'^ = Iq], = [1], = ri] 

then 

K = (1 + b 2 ^) ) ( a + / a 2 +q(bi 2 +b 2 ^) ) 

= / q/ (ti3^^+b2^) a > 0 

= (a/ (b]^^+b 2 ' ) ) (1+ A+ (q(b]^^+b 2 ^) )/a2 ) 

thus Ca-b^^K) < 0 < 3 =^^ r > (a/b^) 2 ( (b 2 /bj^) 2^1) 

Note that q >• £ 2 ^^^ <==> q > 4a\>2^A>l^ 

thus verifying the sufficient condition of Lemma 4.2.4, Note that the condition 
is not necessarv . 


We now present some two-dimensional examples. 


Example 2 


A - 


-1 

0 


0 

1 , 


We have 


K = 


3 

1 


1 

2 


B = 


2 1 
1 2 


T 

HH = 


80 53 

53 37 





= f-7 -4 ] 

= [-5 -5 ] 


A-W, K-W„K 

r -20 

-13 1 

1 2 

L -17 

-13 J 


with ch.p. = s2 + 33s + 39 = 0 i.e. STABLE 
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■A - Wj^K 


-15 

-7 


-8 

-3 


A - W^K 


-6 

-10 



2 

with ch.p. = s + 18s - 11 = 0 i.e. UNSTABLE 


2 

with ch.p. = s + 15s +4=0 i.e. STABLE 


We check 


2l 


2i, ^2 ^ ^ ' 

T 

HH - KW2K = 




55 

28 

28 

12 

31 

25 

25 

21 


which is NOT positive semidefinite 
> 0 


This exaxnpl'; nhus accords with our theory developed earlier. It also illustrates 

examples are supposed to be simple and illuminating - the structural reason why 

stability fails when the second loop is cut. The first control input vector 

b^ ~ ij ^ b igger projection onto the stable subspace than the iinstable 

subspace, and hence it ought to (negatively) feedback with more amplification 

T 

of the unstable state - which it does not (see ) . And the reason it does not 

T 

is because matrix HH penalizes the stable state more than the unstable state I 
Note that the matrix K has the seime 'penalty pattern' as Q. In fact, a short 
computation readily shows that for all matrix solution K of the form 


K = 


a. 1 
1 a. 


Si> 0, 0 


A - W^K will be unstable for all a^<4a^ + 1 (and stable 


(Note that G, 


= 1^2 a^ t 1, 2 + a^j ) 


T 

Intuitively, as the unstable state is penalized more by HH , a^ tends to 
increase, and as increases relative to a^, it tends to put more feedback 
on the unstable state, thus compensating for the relative lack of controllabi- 
lity of the unstable pole by u^. 
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This simple example suggests that the relative projection magnitude of b 
onto the various eigensubspaces as a measure of 'relative controllability' 
with respect to the poles is an important concept worth extending to the 
general n-dimension case. 




We checlt our sufficient conditions; 

- “2*^ = [ T 1/3] > ° 

Q, = - KWjK = ^“3] > 0 

Remark ; This example was used by Rosenbrock in |]R3] to illustrate the undesira- 
bility of traditional LQ-design. 
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^ ■ 3 The Dual Problem : Relicible State -Recons tructor and Kalman Filter Synthesis 

We now consider the natural dual of the reliable stabilization problems 

treated in the previous section: that of designing reliable state reconstructors 

(or observer system ) that are subject to arbitrary sensor input failures. In 

particular, special interests will be attached to the synthesis of reliable 

Kalman filters ( a subclass of state reconstructors) . 

T 

Since the duality theory for the pairs (A,B) , (C ,A) is well-known, we will 
omit all (dual) proofs in this section, and simply formulate the dual problems 
and state the main dual result . Before we can do that, however, we have t o 
briefly discuss a feature of state reconstructuon failures that has no 
analogue in the control context. 

T 

Consider as given the system S -(A,B^,C^ ,ie k) where the observation 
T 

outputs ^ considered as independent with respect to failures . 

A (full order, deterministic) state-reconstructor of is just a dynamical 

yv 

system S : 

X = AX + Bu -t- S F. (y.--y. ) = (A - S F.C,'^)3^ + Bu + v F.y. (4.3.1) 

i£}^ iEk ^ ^ iek ^ ^ 

Define the error e = x - 'x 


Then 

e = 

(A - I F.C.^)e = Ae 


(4. 

3.2) 

and 

hence 

iek ^ ^ 

if A is stable , e (t). 

0 as t — 

— ► , and x(t) 

x(t) 


In the stochastic case when noise disturbances on the plant and sensor 
inputs are taken into account, the state reconstructor takes the same form, but 
with the gain matrices determined (through salving a Riccati equation) from 
the noise statistics (covariance of plant driving and sensor noises) - In this 
case one has of course a (full order) Kalman filter. For siitplicity and consistency 
we will keep to our deterministic notation and refer to 2 as a state-recons- 
tructor, although of course all our results will carry through without change to the 
Kalman filtering context, the formal manipulation for such deterministic-to- 
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stochastic 'translation' being standard. Also, the practical considerations 
of 'tuning' a Kalman filter should be borne in mind when interpreting the 
meaning of the gains F ^ . 

To consider the effect of sensor input failures , let one of the inputs , 
say Yj , be nulled. If nothing else is changed, the error equation will be 
altered to : 

e= {A- E F .C.^)e + F ,c7'x (4.3.3) 

iek ^ ^ ^ ^ 

i.e. a bias term F appears which is due to the 'disappearance' of the sensor 
input y^ . 

To proceed, therefore, we make the assumption that the inp can be 

somehow disconnected automatically when the input y^ fails (this r uires the 

availability of, e.g. fault detection circuitry). When this assumption holds, 

the error system (4.3.3) will become the perfect dual of (4.2.2) subject to 

feedbawi failures. (Alternatively, we can interpret (4.3.3) without the bias 

tih 

term as the result of the j error aparator channel failure) . 

We therefore have the following dual problem to RSP ; 

Reliable State Reconstruction Problem (RSRP) . 

V T 

Given l * (A, , i e K ) , characterize the set 

RSR ( S ) ={ (F^ , . , F ) [ (A - Z F.c.*^) is stable V ICk } 

iek ^ 

v T T 

Denote by D the set of all 1?=(A,C. ,if k) such that the E. = (A,C_. ) are 

^ 1 — lx 

all individually detectable. Clearly a necessarj’^ condition for RSQ(E) # 0 is 
Se;D. The dual of Theorem 4,2.1 is the following: 
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Corollary 4.3.1 


T 

Given Z- (A,C.,iEk) ED 

i " 

Suppose K>0 s.t, for some M,>0 , N.=-nT 

— Ill 

(A+KL. ) is stable V iE^ , where L, ™ C, (N.-M, )cT 

^mrp illll 

and KELP {A +L K) 

1 

If F.= KC. (N.-M.) + K,C. (N.-M.) where M.> 0 , N.ss-n"^ are arbitrary 
11111111 11 ^ 

and K. ELP (a’^+L^K) , K.R(C.)=0, iT^j 

X 1. 3 

then {P ,F, ) ERSR{i:) 

1 k 

One can similarly define the dual of RLQP 
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4.4 The Role of Redundancy in Control Problems 

The use of redundancy has played a long-established role in the 
field of system-maintainability and reliability engineering. There, one 
deals with the best way to connect (or put in standby) redundant congionents 
(each having identical functions) such that the resultant overall system 
performs a reliability characteristics that is better than the individual 
conponents'. In other words, the redundemcy is at the instrumentation 
level . 

We have used the concept of redundancy in a different and more 
abstract sense in this thesis. We have spoken of the redundancy of 
controllability (observability) rather than redundancy of control inputs 
(sensor outputs) , and the reliability synthesis we are trying to achieve 
is at the level of strategy , not at the level of ins trumenta tion of such 
a strategy, i.e. it is the control law itself that we are trying to make 
'reliable’. This concept can (and should be) formalized and its utility 
extended to other strategy/ reliability problems than the one (stabilization) 
we have considered. 

The close connection between such strategy reliability problems 
and the well-studies problems of strategy sensitivity must be noted. The 
latter addresses the question: given a particular solution to a control 
synthesis problem satisfying a set of criteria, how well satisfied is the 
set of criteria when the problem data and/or the implementation of that 
solution are slightly 'perturbed'? The most refined results to date 'f 
such insensitivity synthesis in the context of control systems have led 
to the enunciation of so-called 'Internal Model Principle' ( [Fl] ) , 'Steady- 
state Invariance Principle' ( [Nl] ) and 'Perfect Control Principle* ([D2]), 
where the role of redundancy has further been clarified. It is hoped that 
similar advances will be made in the context of reliability synthesis, and 
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ive that such advances will lead to a better understanding of the 


dee^ C'snn^C-Vion between system coordincibility and redxmdeuicy. 



4.5 


Kdsf and LQ- feedback j Some now perspectives 


In this section we briefly recapitulate the new insights that our earlier 
results have shed on stabilizing feedback. 

One new perspective is the following ; the class of LQ-feedback can simply 
be regarded as a subclass of ndsf that always stabilizes the open- loop system. 

Prom this perspective, it becomes clear that some of the known desirable 
properties of LQ-feedback {infinite gain margin, compatible stabilization, 
tolerance to nor.linearities in the (1/2, ™ ], and perhaps phase margin and 
asymptotic 'Butteirworth ' pole pattern ) really has very little to do with the 

fact that the feedback term comes from some LQ— optimization they are simply 

structvrral properties of ndsf. I^-optimization amount j to choosing a member 
of this class that stabilizes, but that may be other shorter means to that choice 
in certain situations. 

The practical implications of this observation with respect to 'suboptimal' 
design is significant. First, in situations where physical intuitions are of 
no help in pinning down an a apriori preferred feedback choice, and where 
'simulation trials' are resorted to, the above insight suggests that , rather 
than using an adhoc search, or else employing adhoc ’ dyadic ' feedback technique, 
'reduction to single control' technique, etc., which are of mathematical conve- 
nience but. of little physical or structural justification, it could be more 
fruitful to limit the search to the class of ndsf. Recall the following fundamer.-.al 
of compatible ndsf : each feedback loop can be individually shaped without 
destroying the stability of the collective closed-loop system. This property, and 
its (dual) reliable stabilization interpretation, are of great practical 
importance . 

Secondly, it suggests that, in situations where the 'Q' and 'R' terms 
of LQ-design are really of little physical intuitiveness, one may bypass 
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iterating on many trial .KLccati equations , and instead iterate on the class 
of admissible feedback modifications allowed by Theorem 3,4.1, 3.4.2 for 
'fine' tuning once a 'nominal' LQ-feedback has been obtained. Further, the 
initial choice of 'Q' and ' P' should be guided by considerations of their 
structural consequences on the resultant feedback maps. Similarly, sensitivity 
analysis with respect to structural perturbations of the feedback loop or 
to implementation imperfections may be carried out if such changes can be 
modelled by the class of allowed changes we have identified. 
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CHAPTER 5 


STRUCTURE OF DECENTRALIZED CONTROL SYSTEMS 

5.1 

xn this chapter we turn to study the structure of linear, multivariable 
decentralized model of large-scale dynamic control systems. Our primary 
objective is to obtain more precise structural characterizations of the very 
concept of ’decentralization' in the large-scale control system control 
problem context in terms of our previous interaction structure and feedback 
coordination concepts. 

By a ’large-scale* dynamic system we singly mean a dynamic system with 
many control stations and many observation stations which are physically distinct 
and spatially separated. The control problem consists simply of determining 
a real-time inplementation scheme that does not violate the natural physical 
constraints of the system being modelled. This qualification is inportant, 
since it is these extra considerations that justify distinguishing a problem 
as ’large-scale' as opposed to just any multivariable control problems. 

Informally, a system 'plant' is large-scale because, firstly, the 

control input channels and sensor output channels are spatially separated 

from one another and among themselves, and to transmit information to where 

it can be actuated requires hardware {a communication network) that costs 

to build as well as to operate and maintain. There is also the inherent 

transmission delay, uncertainties in the information content and its fiirther 

degradation in the transmission process. Secondly the system has to be 

operated in real-time, and continuous real-time human decision-making is 

costly, unavailable or unreliable — — hence the need to pre-program the 

control strategy as much as possible, thus reducing the task of human decision 

making to an initial problem formulation and off-line conputation of control 

strategy and subsequent routine operations and periodic intervention and adaptation 
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where necessary; similarly, real-time cortputation limitation must be obeyed. 

In other words, the complexity of the control law computation must be suitably 
restrained. Thirdly, inplementation of control strategy physically requires 
instrumentation that, once built can not be freely substituted later without 
incurring costs; the conplexity of the control law inplementation are constrained. 
Finally, human institutional constraints which although are external to the 
dynamic description of the system plant, nevertheless my 'constrain the admissible 
control strategy or its inplementation . In a capitalist production firm the 
control (’management') strategy is "'hierarchical' not because that strategy 

is 'optimal* with respect to some abstract 'team decision' criterion as 

some people are trying to nystify but sinply is an imposed institutional 

constraint that ensures that the owners of capitals have control over the 
management of production rather than the workers. Similarly, the 'bureau- 
cratic' set-up in many real v/orld control systems is an human institutional 
constraint that often has little to do with considerations of the effi- 
ciency of that particular mode of control strategy. 

The above informal discussion serves merely to point out some of 
the more important physical origins of decentralization in the real-time 
implementation of many large-scale control systems. In any truly realistic 
optimal control problem formulation, the particular form of decentralization 
will of course follow from the solution itself. On the other hand, 
failure to realistically incorporate all possible implementation cost 
(communication network, computational software and hardware , etc. ) into 
the optimization problem formulation will lead to highly unrealistic or 
inferior strategies; the 'optimality' with respect to an unrealistic 
cost criterion is deceptive. 
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Our objective in this chapter is therefore not to grapple with the 
issues of optimality, but rather that of feasibility : given a particular 
class of decentralization constraints, what are some of the meaningful 
control problems one can formulate that respect the imposed decentralizar 
tion constraints? Given a particular decentralization constraint and a 
particular control objective , how to characterize (parametrize) the 
class of all feasible solutions ? 

To be able to do so, we first need to have some meaningful scheme 
for classifying different possible kinds of decentralization constraints. 
This we will do in 5-2 , albeit in an informal manner. We will then 
present in 5-3 some classes of linear multivariable decentralized control 
problems to illustrate the framework provided by 5.2 


5.2 Classification of decentralised control problems 


In this section we present informally a scheme for classifying several 
important types of decentralisation in control problems. 

The basic conponents of a large-scale decentralised dynamic control 
problem are conceptualised as in Pig. 5.1. 

The basic tasks we identify are: 

1) information distribution problem 

a) a priori structural information 
the problem is either 

i) given an initial common pool of available a priori information (system 
model, control objectives, stochastic description of noises, etc.), how 
should the information be shared by the different control agents 
or ii) given a priori inforWc ' n that are decentralised to begin with, how 
should the information be pooled, exchanged, etc. 
or both. 

b) a posteriori (or real time) observation from sensor channels and 
communications of control actions. The problem is (1) who should be 
provided with which observation channels; (2) which control stations 
should communicate with which other control stations to exchange 
control information ( what they have done, what they will do, etc.) 

Any particular solution of the information distribution problem fixes 

a particular information pattern . For each given fixed information pattern, 
we can consider the next task: 

2) (Off-line) Control strategy computation problem 

The problem is roughly, given a particular information set , con^jutes (off- 
line) a control law, that is a map: (observations) I ► (control values) from 
eimong the class of all such maps admissible by the information constraints , 
causality, and other physical constraints, etc. 
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Giv^ a fixed information pattern Eind an admissible pre-con^uted control 
law, one can go on to task 3: 

3) On-Line Control Implementation Problems 

The problem here is to simply execute the on-line information processing 
and control actuation 

Although other tasks (eg. adaptive control, learning, i.e. aggregation 
of a posteriori information into a priori structural knowledge, etc} can be 
identified , we will confine ourselves to the above three. We further remark 
that the above task identification represents merely an attempt at conceptual 
clarification, since in practice, such rigid demarcation cannot be made, and 
often the solution of the earlier task are constrained and defined by the 
limitations of the later tasks, e.g. control law computation may suggest or 
dictate what information distribution pattern should be made; similarly, limi- 
tations on on-line information processing capacity may constrain the level 
of complexity permitted in the selection of control laws. 

We make the observation here that, conceptually, each of these ttiree 
tasks can be carried out by the same or different agents. Thus it is useful 
to Identify 3 classes of agents: information (a priori or a posteriori ) 
distribution agents, control decision-making (strategy^-deterndning) agents, 
and on-line control implenentation agents. The complexity of the control 
problem depends on the arrangement of task distribution among the agents. 

The problem is simplest when there is only a single agent performing all the 
tasks (centralized control case), but the nature of many 'large-scale' system 
problems often dictates that the agents be different - in such a case we have 
a 'decentralized' control problem. The 'decentralization* can be due to 
different agents performing the different classes of task (e.g. the control 
actuation operator is different from the control decision-maker) , or to 
having different agents performing the same class of tasks (e.g. different 

control operators 'manning' different control stations) . 
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Our informal discussion above has thus suggested the following 
(non-exhaustive) conceptual classification of ’decentralization* in control 
problems , 



a priori 

Information 
a posteriori 

control 

observation communication 

Off-line 
control law 
computation 

On-line 

control 

implementation 

Case 1 

Cen. 

Cen. 

Not needed 

Cen. 

Cen. 

Case 2 

tl 

II 

II 

Dec. 

II 

Case 3 

IT 

Dec. 

None 

Cen. 

Dec. 

Case 4 

If 

fl 

Allowed 

It 

■ 

Case 5 

Dec. 

Dec. 

None 

Dec. 

Dec. 

Case 6 

Dec 

If 

Allowed 

M 

tl 


Case 1 


This is the traditional centralized control problem situation. 

Case 2 

This is the situation when the control law computation problem is 
too big and complex to be solved centrally, and decentralization {'decomposition') 
is introduced at various computational levels. 

Case 3 

This is the situation when measurement information are localized either 
because it is too costly, infeasible or else irrelevant to transmit observation 
information from every sensor channel to every control inplementation agent. 
However, the control strategy is still centrally confuted by a single decision- 
making agent with access to all a priori information. The control law 
determination task here is much more complicated than previous cases since the 
constraint of decentralized a posteriori information pattern has to be respected. 
Also, the control law determination problem tends to become 'ill-posed* unless 
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explicit penalty or constraint on the cost of computational and implementational 
complexity is imposed, since otherwise the decision-maker with all the a priori 
information, will try to assign complicated control strategies to the control 
implementation agents to allow them to generate as much information from their 
constrained obseirvation channels as possible; the performance of the overall control 
scheme is also highly sensitive to any local control agent failure since the 
individual strategies of all the control agents are strongly 'interlocked'. 


case 4 

This is the same as case 3 but with certain channels for control information 
exchange available. The control strategy of each controller will be made 
a function of both the aposteriori state observation as well as observation 
of the control values of other controllers. 
case 5 

This is the situation when there are more than one decision making agent, each 
having a different a priori information set, and each responsible for 
computing the control strategy for one subgroup of the control implementation 
channels, subject to decentralized observation information constraints. The 
complexity of the problem depends on how much overlap there is between the 
aprior information sets of the decision making agents. Too much apriori 
information overlap will lead to each decision agent trying to 'second guess' 
the strategy of other agents, and thus leads to complicated control laws. 

case 6 

This is case 5 with additional control information exchange. As in case 4, 
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the allowance oi' real-time control value communication will lead to extremely 
complicated individual control strategies unless computational and memory 
storage capacities of the individual agents are constrained to prevent them 
from trying to 'guess' the control strategies and 'informational states' of 
the other agents. 

In summary, then, we can identify completely the decentralization 
pattern of a control problem in terms of : 

1) a priori information distribution pattern 

2) aposteriori observation channel distribution pattern 

3) control implementation (actuation) channel distribution pattern 

4) online control info-^mation communication pattern 

( In the case when there are multiple number of independent decision- 
making agent , we have ass\amed that they all share the same set of control 
objectives ; when this is not true (e*g* game of conflicts) we have to 
specify in addition the controlled output- channel distribution pattern . ) 

The concept of coordination can be naturally interpreted within the 
above freunework. It follows simply from the fact that certain set of control 
objectives are impossible to achieve with certain given fixed decentralization 
pattern (either the problem admits no physically imp lament able solution or 
else the computational task is too complex) . One ie thus faced with the 
problem of finding rules for relaxing the originally given decentralization 
pattern until a feasible solution exists. Conceptually, this process of 
relaxation of problem constraints involves the introduction of a coordinating 


agent . 


The process of coordination can be carried out at the off-line 
control-strategy computational level or at the online strategy-implementa- 
tion level. Most of the existing literatures on 'hierarchical, multilevel’ 
approaches to decomposition of offline computation (see, e,g., [C3],[M4]) 
fall into the first category , will develop a slightly different notion 
of coordination in 5.4. 



5 . 3 Some classes of Linear Multivariable Decentralized Control 
Problems 

In this section, we review and re-interpret or generalize where 
appropriate several classes of decentralized control problems in the linear 
multivariable system context to illustrate the framework of 5.2 . 

We begin with a case of extreme decentralization pattern: 

Decentralized Pole Assignability Problem 

Given I ={A,B^,C^T,iG^) and ACC, [A|=n, let there be k independent 
decision-making agents such that: 

1) each agent knows the a priori structure I and the specification A 

2) agent i has access to only the channels u, and y. 

11 

3) each agent were to independently compute an output feedback law : 

u. = F.y. 

1 11 

i.e, agent i does not know whac is, ij^j 

Dnder the assumptions (1) , (2) , (3) , for what structure of Z is it 
possible for 

OCAH- Z B.F.C."^) = A V A C C ? 

iek ^ ^ ^ 


Remark 

This is a case of decentralized control law computation with decentralized 
observation and control actuation channels and no communication of control 
values among the k agents allowed. 
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This formulation is a re-interpretation of a pvoblem first posed by 

Eckberg [El,Chap.2] . We can generalize this problem by relaxing the exact 

pole assignment requirement. 

Decentralized C^-Assignability Problem 

Given E and C C , and assumptions (1) , (2) , (3) for what structure 

of Z is it possible for 

o{A+ E - C ? 

^ 3. 1 g 


Remark 


The restriction to output feedback can be relaxed by allowing dynamic 
compensation in the standard way (see, e.g. [W6]) without destroying the 
nature of the dece' tralization. 

A further generalization is to allow state reconstructors to be used 
by the independent agents. The consequence of this for the case when no 
control communications are allowed is well-known (see [El]): each agent 
regards the control input signals of other agents as unknown disturbances, 
and the largest unreconstructible subspace U ^ of agent i is just 
^ = I (a , [B^ , . . ^ . ,Bj^] ; N(C^ )) 


Letting N 


1 


we 


have that each agent has effectively enlarged its observation channels , 


and can effectively apply the feedback u,=F. 

JL ^ 


1 
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We can modify the above extreme decentralization pattern by allowing 
exchange of the implemented control values between different agents in real- 
time, but at the same time impose the assumption that the agents are of such 
limited computational and memory-storage capacities that they are not capable 
of trying to 'guess' the control strategies and information, states of other 
agents. Under such a controller complexity constraint, control information 
exchange amounts to allowing the independent agents to remove unknown biases 
in their state-reconstruction from measurements that are affected by the 
control signals of other agents. Note that transmission^ of an agent's entire 
control vector to other agents d.s not necessary; only that part of his 
control signal that affects the observable si^^spa-ce of another agent need 
be transmitted. { One version of this problem has been considered by Aoki in 
[A5]. } With control communication and under the assumption that each agent 
uses a state-reconstructc'*, therefore, we are effectively allowing each 
agent to feedback his entire observable subspace (and by the 'deterministic 
separation' principle (see [W6]) it can be argued that no more dynamic 
information processing are necessary) . 

The constraint of independent gain computation turns out to be very 
severe; essentially only systems whose control interaction structure is 
either interaction -free (i.e'. ' else is nested (see pp.32) and 

whose observation channels are independent can achieve such decentralized 
pole-assignment ( see [El] for details) . 

We therefore turn next to consider a less extreme decentralized 
control problem. 
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Centralized Pole-assignability with decentralized channels Problem 


Given S={A,B^,C^ , iclc) and A C C , [A|=n, does there exists 
(F^,...,Fj^) such that 

(A+ B.F.C,'^') = A V ACC ? 

. . 1 1 X 


Remark 

This is the case of centralized control law computation by a single 
decision-making agent who has access to all a priori structure information, 
but with observation and control actuation chainnels decentralized ( so that 
control implementation has to be decentralized) , and no control information 
communication allowed. 

Remark 

This problem can be generalized to allow dynamic compensation in the 
standard way. 


When conplete pole-assignability is not required, we have the less 
stringent problem : 

Centralized Stabilizability with decentralized channels Problem 
Given S , does there exists { Fj^,...,F^) such t^:iat 
a(A+ S B-F-C."^) C C “ ? 

X 1 1 

x£k 


The dynamic feedback version of this latter problem has been posed 
and solved by Wang and Davison [Wl] . 
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5.4 Decentralized Feedback Coordination 


In the last section we have considered problems which either have 
completely decentralized control strategy computation or else completely 
centralized control strategy computation . In this section we formulate 
a class of problems that have the control law computational task partially 
centralized and partially decentralized . The basic idea is that the 
centralized part of the control strategies represent the coordinating 
constraints imposed by a central decision-making agent who has access to 
all a priori structural information (and is thus called the coordinator) , 
while the decentralized part of the control strategies represents the 
degree of freedom or independence that each local control actuation agent 
can exercise. The task of the coordinator, in ether words, is to 
parametrize the degree of freedom of each of the local control agent and 
assign that a priori constraint information to the individual agents. 

The motivation is as follows. In any realistic synthesis problem 
there are always a large number of feasible solutions that satisfy a 
particular set of control objectives ( keeping a system stabilized, 
localizing a particular disturbance,etc. ) . While the use of cost- 
criterion optimization in theory allows a central agent to pick out exactly 
one choice (the optimal solution) , in practice the difficulties of incor- 
porating all the relevant cost considerations necesitates further trial 
and error ’hedging’ about the nominal solution. In a large-scale system 
it is desirable that such further 'fine-tuning' be done decentrally by the 
local agents rather than by the central agent. It is therefore desirable 
that the central agent does not completely fix the individual control 
strategies of the local agents. In this spirit, we have: 
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Lemma 5.4.1 


Given E ,i0k) 

■k -k 

If there exists (K^ , . . . ) such that 

(A+ E B.K, C."^) is stable, then 

.,111 

T * T 

CA+ E B. ( (K.-M.)B. C.L.+K. )C. ) is also stable (5 4 1) 

.,1 111111 i 

V L. > 0 such that L.C. R(B.) = 0 , i^j 

T 

and N^=-N^ , ® arbitrary (5,4,2) 


Proof 

This is a straight-forward generalization of Theorem 3,2.1 


Remark 

The tasks of the central coordinator are; 

* * 

1} Select a feasible (K^ ) . This can be done offline. 

* 

2) Transmit to each agent i the specification and the constraint 
specification (5.4.2) . This can be done offline too. 

* 

The task of the local agent i is to simply implement and to perform 
'fine-tuning' within the constraints imposed by (5.4.2) 

Although the content of lemma 5.4.1 is too crude (the constraint (5.4.2) 
is sufficient but highly unnecessary) and no doubt has to be strengthened for 
it to be of practical significance, it is the conceptual interpretation it 
gives rise that we feel is of importance. 
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CHAPTER 6 


CONCLUSION 

In this thesis, a study of the two closely related problems of 
designing reliable multi-loop feedback stabilization strac.jgies and of 
coordinating decentralized feedbacks has been initiated. Although only 
partial solutions have been obtained so far, to the problem posed, we 
feel that the approaches we have taken shed much new insights that not 
only have generalized our understanding of the properties of multi-loop 
feedback interaction, but have also provided a very useful conceptual 
framework for the eventual solution of the originally posed problems 
and other related problems where feedback interaction is iitportant. 

The main contribution of this thesis has been the exploitation of 
the idea of parametrizing directly the class of feedback maps that 
realizes a particular control objective rather than indirectly through 
looking at the subspaces they leave invariant, etc. Such an approach 
provides an explicit and therefore powerful means for generating feasible 
solutions that moreover have easy structural interpretation. Despite 
the elementary nature of our techniques (Lyapunov stability theory, LQ- 
feedback) , our results in Chapter 3 and 4 have in fact provided a 
pararoetrization of an inportant class of feedback maps that have the 
independent loop-adjustment property . The significance of this property 
with respect to practical design (interactive search, 'fine tuning', 
protection against failure) have already been pointed out. In addition, 
our approach leads very naturally to the idea of coordination parametrization. 
The 'fixed' part of the individual controller's feedback map can be 
interpreted as the coordination constraint selected by the coordinating 
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agent, while the remaining degrees of freedom can be independently implemented 
by each individual control agent. The significance and attractiveness of this 
concept in the decentralized control context is immediate, and no doubt can 
be more extensively and vigorously developed in a formal context. 

As a side benefit, our identification of the structure of the class of 
non-destabilising feedback maps has allowed us to make transparent as well as 
to generalize the structural stability properties of LQ-feedback. 

Our second hoped-for contribution lies in the introduction of a concept of 
'structural' homomorphism based on the idea of classifying systems according to 
their control interaction (observation interdependency) pattern. The relevance 
of this concept for system structural classification and for refining our 
understanding of model aggregation has already been pointed out. 

Finally, the informal decentralization pattern classification scheme we 
presented in 5.2 represents an initial effort at clarifying the conceptual 
basis for modeling the structural aspects of large-scale decentralized 
control systems, and we hope that the framework provided can be contributive 
towards a more precise and formal treatment. 
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Suggestions. For Further Research 


Lack of time did not allow us to pursue in depth the many interesting 
venues for further research opened up by this thesis work. As suggestion 
for further research topics, we list the following: 

1) To obtain a conplete solution to RLQ in its full generality. If RLQ( j; ) 
is non-enpty for only a subset of all ^ e S, obtain a parametrization 

of this subset in terms of the interaction structure ideas. If one 
system does not admit an RLQ synthesis, does this imply that every system 
structurally homomorphic to it also does not admit RLQ synthesis? If 
not, what other (stronger) forms of ’structural equivalence' can we 
inpose? 

2) Generalize the class of non- destabilizing state feedback maps to 
allow for dynamic feedback compensation, i.e. what is a convenient 
parametrization of a class of dynamic compensation and output feedback 
maps that also have the non- destabilizing property? The stabilizing 
property? It is known that by putting an extra cost term involving a 
quadratic form of the control derivatives , one cein get a generalized 
LQ-problem that yields an optimal dynamic feedback solution. Can this 
idea be used to generate a class of reliably stabilizing dynamic 
feedback maps? 

3) Consider other types of system reliability problems: e.g. reliable 
disturbance-localization synthesis , reliable regulation and tracking 
with internal stability, etc. 

4) Formalize and extend the notion of viewing the selection of cost 
weighting matrices as a coordination strategy in a more general 
framework . 
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5) Investigate the relation (if any) between Theorem 3.4.3 and the frequency 
domain characterization of phase margin properties. 
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